23d ago in 🧱 | Strategy & Design
ETL Recommendations
Hey all
My company currently has a bunch of lambda functions in aws that extract data from APIs into S3 and then into snowflake. The Lambda function process is working but has limitations.
a) Its has a complex set up and to make changes it takes lots of time,
b) Monitoring isn't very visible.
c) CDC is a challange to manage
Since i probably wont be able to get the company to pay for a new tool to do the ETL i need to think of some free tools I can recomend that makes the pipeline robust and easy to monitor add sources and make changes quickly..
I am looking at Airbyte - any advice on this?
What alternatives other alternatives are there perhaps?
2
4 comments
ETL Recommendations
Public group
A community of data professionals building architectures with modern tools & strategies.
Leaderboard (30-day)
1
+7
2
+7
3
+4
4
+3
5
+3
powered by