Using AWS Lambda As A Data Engineering - Automating An API Extract With AWS Lambda And Eventbridge

I recently posted the first video in a series about AWS and data engineering. This is the second video where we will dive into how you can use AWS Lambda to perform automations to scrape data from an API. You can find the basic code here - https://gist.github.com/bAcheron/8945... Also if you'd like to see the prior video you can find it here: AWS Services YoU Need To Know As A Data Engineer    • Best AWS Services You Need To Know As A Da...   If you enjoyed this video, check out some of my other top videos. Fastest way to become a Data Engineer in 2024 - 100 Days Of Data Engineering    • Fastest way to Start Your Data Engineer Jo...   Intro To Databricks - What Is Databricks    • Intro To Databricks - What Is Databricks   If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/s... Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe:    / @seattledataguy   _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

Smart City End to End Realtime Data Engineering Project | Get Hired as an AWS Data Engineer
▶︎

Smart City End to End Realtime Data Engineering Project | Get Hired as an AWS Data Engineer

AWS Glue ETL Job | How to create Glue ETL Job using PySpark | Transform S3 Data using Glue PySpark
▶︎

AWS Glue ETL Job | How to create Glue ETL Job using PySpark | Transform S3 Data using Glue PySpark

Extracting Data From APIs As Data Engineers - The Basics And Challenges You'll Run Into
▶︎

Extracting Data From APIs As Data Engineers - The Basics And Challenges You'll Run Into

UPDATED - Create Your First AWS Lambda Function | AWS Tutorial for Beginners
▶︎

UPDATED - Create Your First AWS Lambda Function | AWS Tutorial for Beginners

AI, DevOps, and Kubernetes: Kelsey Hightower on What’s Next
▶︎

AI, DevOps, and Kubernetes: Kelsey Hightower on What’s Next

AWS Glue Full Course For Beginners (2026 Step-By-Step Guide)
▶︎

AWS Glue Full Course For Beginners (2026 Step-By-Step Guide)

How To Build A Data Platform Episode 1 - What is a Data Platform?
▶︎

How To Build A Data Platform Episode 1 - What is a Data Platform?

Automate Daily Data Analysis with Amazon Athena, AWS Lambda, & S3 (Step-by-Step Guide + Free Code)
▶︎

Automate Daily Data Analysis with Amazon Athena, AWS Lambda, & S3 (Step-by-Step Guide + Free Code)

Databases Vs Data Warehouses Vs Data Lakes - What Is The Difference And Why Should You Care?
▶︎

Databases Vs Data Warehouses Vs Data Lakes - What Is The Difference And Why Should You Care?

Zig 2026: No-AI Policy, $670K Foundation, Left GitHub & Why Zig Isn’t 1.0 - Andrew Kelley Explains
▶︎

Zig 2026: No-AI Policy, $670K Foundation, Left GitHub & Why Zig Isn’t 1.0 - Andrew Kelley Explains

AWS Lambda For Absolute Beginners: Python Tutorial in 25 Minutes
▶︎

AWS Lambda For Absolute Beginners: Python Tutorial in 25 Minutes

Build & Deploy ML Churn model with FastAPI, MLFlow, Docker, & AWS
▶︎

Build & Deploy ML Churn model with FastAPI, MLFlow, Docker, & AWS

Data Lake Modeling: 100 TBs into 5 TBs at Airbnb with Parquet + Run Length Encoding - DataExpert.io
▶︎

Data Lake Modeling: 100 TBs into 5 TBs at Airbnb with Parquet + Run Length Encoding - DataExpert.io

AWS Lambda | Function URL | Environment Vars | Lambda Layers - Step by Step Tutorial (Part -17)
▶︎

AWS Lambda | Function URL | Environment Vars | Lambda Layers - Step by Step Tutorial (Part -17)

AWS ETL Pipeline Project For Beginners | AWS Data Engineering Project
▶︎

AWS ETL Pipeline Project For Beginners | AWS Data Engineering Project

How And Why Data Engineers Need To Care About Data Quality Now - And How To Implement It
▶︎

How And Why Data Engineers Need To Care About Data Quality Now - And How To Implement It

Build an End to End Data Pipeline on AWS | AWS Lambda, S3 Bucket, EventBridge Trigger , Marvel Data
▶︎

Build an End to End Data Pipeline on AWS | AWS Lambda, S3 Bucket, EventBridge Trigger , Marvel Data

تلاوة القرآن للدراسة والتركيز 📚🕛 | راحة وطمأنينة | Peaceful Focus Quran | محمد هشام
▶︎

تلاوة القرآن للدراسة والتركيز 📚🕛 | راحة وطمأنينة | Peaceful Focus Quran | محمد هشام

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker
▶︎

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Create Lambda Layers | Easily Add Python Dependencies to Lambda with AWS Layers
▶︎

Create Lambda Layers | Easily Add Python Dependencies to Lambda with AWS Layers