How in fabric can i call an api with multiple pages?

Sep '24 (edited) • 🤓 Tech Chat

Hi i need to call an api that has a limit on its record count and it spread across multiple pages. A good public example of such an api is rickandmortyapi.com/api/character ive been going down the path of pulling the api data and manipulating it in a fabric notebook by importing requests and looping through pages. however in every fabric example when they source from an api they always advocate using data factory/datapipeline. i cant seem to find an example on how to handle paging through the results as every example seems to call a single page. any help would be appreciated . Ross

3 comments