No video :(

Building a Real-Time Data Processing Pipeline with AWS Kinesis, Lambda, S3, and Python: Hands-On

Подписаться 2,3 тыс.

Просмотров 1,2 тыс.

50% 1

One of our popular tech videos, though we don't produce them anymore. Follow us for insights into Wall Street financial instruments.
Explore real-time data processing in the cloud! Learn how to build a robust pipeline using AWS Kinesis, Lambda, and S3, all coded in Python. This hands-on tutorial guides you through processing dynamic weather data, showcasing the power of serverless architecture for seamless data ingestion, transformation, and storage in the cloud. Elevate your AWS skills and dive into the world of real-time data engineering! Prepare for DEA-C01 certification.
Elevate your skills and readiness for an AWS Data Engineer role with practical insights and a hands-on approach to AWS technologies.

Опубликовано:

5 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 7

@shaikhabubakarshaikhhabeeb8554 3 месяца назад

superb video please make more videos on End to End Data engineering such real time data as well batch from Kinesis to Redshift . S3,Kinesis, Aws lambda,Glue,Redshift

@wallstreetmindsetpro 3 месяца назад

Please check this course ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-bx-fwTnrNQY.html

@learning7220 29 дней назад

Shouldnt we be using kinesis data fire hose?

@wallstreetmindsetpro 27 дней назад

That is another option

@believer0010 Месяц назад

Error writing to S3: An error occurred (AccessDenied) when calling the PutObject operation: Access Denied I got this error msg among the other messeages like init info in the logs. How can I fix this exception

@wallstreetmindsetpro Месяц назад

Check IAM Role Permissions: Ensure the IAM role associated with your Lambda function has s3:PutObject permission for the target bucket. Verify S3 Bucket Policy: Ensure the S3 bucket policy allows the Lambda function's IAM role to write to the bucket. Check Environment Variables: Ensure the Lambda function has the correct S3 bucket name and configuration set in its environment variables. Test the Lambda Function: After updating permissions, test the Lambda function to confirm it can write to the S3 bucket successfully.