40
Question: How to curl the lemmy API? (lemmy.world)
submitted 2 days ago by egeres@lemmy.world to c/programming@programming.dev
18 comments fedilink hide all child comments

I've seen these posts

But actually I haven't been able to figure out exactly how to get the posts a user has made in lemmy. I've seen this page but I think this is for a different lemmy instance, I'm not sure https://join-lemmy.org/api/interfaces/GetPosts.html

Can anyone point me to a documentation on how to make this?

top 18 comments
sorted by: hot top controversial new old
[-] refalo@programming.dev 25 points 2 days ago* (last edited 2 days ago)

curl 'https://lemmy.world/api/v3/user?username=egeres&sort=New&page=1&limit=20' | jq .posts

https://join-lemmy.org/api/classes/LemmyHttp.html#getPersonDetails

The documentation is really terrible and the developers try to defend it anyways.

Some instances also employ cloudflare or other anti-ddos techniques that make automated API usage impossible.

[-] onlinepersona@programming.dev 5 points 2 days ago

Unofficial documentation using OpenAPI is here @egeres@lemmy.world .

Btw, the user interface uses the same API. Just open the web developer tools in your browser and look at the network tab.

Anti Commercial-AI license

[-] refalo@programming.dev 5 points 2 days ago* (last edited 2 days ago)

This is still written from a javascript perspective and assumes many things that are not true when using other approaches to calling the endpoints.

[-] testAccount@programming.dev 1 points 1 day ago

(Author btw)

Can you expand on this? This was written for Kotlin usage. It automates generating API based on this spec.

I have no idea what you mean with 'using other approaches to calling the endpoints'

Lemmy has only one API. It's same API used for lemmy-ui.

This is just a "better" documentation for it.

The API works for for cloudfare instances too.

There is also a swagger ui variant

https://mv-gh.github.io/lemmy_openapi_spec/swagger_ui.html

[-] refalo@programming.dev 2 points 1 day ago* (last edited 1 day ago)

This thread sums everything up nicely I think: https://lemmy.ml/post/98675/95459

And for programming.dev specifically, the API did not work for me when they had CF bot protection turned on (endpoints always returned the "Just a moment..." bot check html), it was only after it was turned off a few days ago that it started working for me, because CF doesn't like my IP/browser/something and always gives me endless captcha loops. Previously their stance was that bot IPs had to be explicitly whitelisted to be allowed on their server.

[-] testAccount@programming.dev 2 points 1 day ago

I do not see how critisms for the JS API docs are relevant for my openapi documentation.

This documentation aims to solve all those problems in a language agnostic way. It descibes the endpoints, the request object, the status, the response object, the authentication needed in visual/text. It allows you test it right from the browser, allows you to copy a working curl command, search for endpoints based on keywords, allows you to import the entire spec into postman/alts.

I ve never had any problems with CF instances but I mostly test with voyager.lemmy.ml

[-] refalo@programming.dev 2 points 1 day ago

Yours is a little bit easier to read, but my main problems remain the same. Here's some initial comments looking at your swagger link from the perspective of a user who is brand new to the lemmy API (and doesn't use Javascript):

  • I can't tell what the general flow of the API usage in general is. Am I supposed to login/authorize somehow first? Some common examples, especially in at least one programming language (whether that's curl or python or whatever) I think would go a long way to help people understand what they're supposed to do.

  • How do I know if I need to authorize for a particular endpoint?

  • What is the entire URL for any given endpoint? It's never really explained clearly.

  • What is this "servers" dropdown? What's the difference between those?

  • Endpoint descriptions are often unhelpful. /user says "Get the details for a person." It doesn't tell me this is actually how I'm supposed to find their comments or posts. Nothing tells us this.

  • We have to guess what endpoint we might need for a lot of things. Example: /post/like is also for dislikes, but it doesn't tell you that. It also never tells you HOW to like or dislike anything, the valid values of score do not appear to be documented. And you're left to assume that's the right field to even use for it.

  • What is the content type of the request supposed to be? JSON is never mentioned anywhere.

  • What are these named "parameters"? Is that a query parameter? Why does it say "object" and "(query)"? Does this parameter go in the request body instead? /user shows a parameter called "GetPersonDetails" except in reality this name is (I guess) supposed to be completely ignored, because no part of the request actually uses the string "GetPersonDetails".

  • Schema is missing for many endpoints, like the request part of /user.

  • What are all these fields under "GetPersonDetails"? Are they all required? Only some? It doesn't say anything about it.

  • Many of the possible error codes are undocumented.

There's probably more but that's the main stuff I think.

[-] expr@programming.dev 0 points 1 day ago

Confused what you mean. OpenAPI has nothing to do with JS.

[-] egeres@lemmy.world 3 points 2 days ago

Thank you so much!!!

[-] Illecors@lemmy.cafe 12 points 2 days ago

I've found this more understandable.

I've also hacked together a quick thing for spamwaves that were happening last year here.

The purpose of that script is to ban, but there're auth bits that might help you get a grasp on your task.

[-] egeres@lemmy.world 2 points 2 days ago

Many thanks!! I'm just trying to make a silly script to plot how often I comment on lemmy over time :)

[-] tmpod@lemmy.pt 5 points 2 days ago

+1 for lemmy.readme.io, it's much easier to read than a JS lib documentation.

[-] testAccount@programming.dev 1 points 1 day ago

Looks like the best openapi front. I looked into using it, but it didn't seem free. Too bad this one is outdated. Lemmys API has changed quiet a bit since then.

[-] tmpod@lemmy.pt 1 points 1 day ago

readme.com (aka readme.io) ain't libre, but it has a free plan.
I also think it's a bit on the heavy side, but what isn't these days...

[-] testAccount@programming.dev 1 points 1 day ago

Ah yes, all though I ve never really experienced HTTP days in their full glory

I'll look into using it. If it has a github action or easy way to publish it from cli

[-] iso@lemy.lol 1 points 2 days ago* (last edited 2 days ago)

You can see the URL and request body from LemmyHttp class method docs: https://join-lemmy.org/api/classes/LemmyHttp.html#getPosts

[-] refalo@programming.dev 7 points 2 days ago

I really do not like these docs and find it extremely confusing for anyone not using Javascript. For example that "form" parameter that's on almost everything, doesn't even exist and can't be used when you're using curl, but it doesn't tell you that.

[-] iso@lemy.lol 1 points 2 days ago* (last edited 2 days ago)

These docs are for latest Lemmy version so you may experience some mismatches with a legacy instance but I didn’t see something like that so far.

TBH I find the docs very easy. It’s about JS documentation familiarity I guess.

this post was submitted on 29 Jun 2024
40 points (97.6% liked)

Programming

16207 readers
531 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 1 year ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev
MaungaHikoi@lemmy.nz