PinnedPublished inAWS TipData Engineering — Understand AWS Serverless ETL — Glue!!In a Data Warehouse eco system, the most time consuming part is the ETL process. ETL stands for E(Extract), T(Transform) and L(Load). The…Jul 6, 20231Jul 6, 20231
PinnedData Engineering — Understanding Roles in Snowflake — Beginner level.Snowflake is a popular cloud data warehouse solution in the current market. Many organizations are using snowflake for building their…Jul 3, 20231Jul 3, 20231
PinnedData Engineering — Understaning Snowflake architecture from a beginner prospective!!Snowflake is the most popular cloud data warehouse solution at present. It enables data storage, data processing and advance analytic…Jun 28, 20231Jun 28, 20231
PinnedData Engineering — AWS Data and Analytics — Collection — Kinesis Data StreamAmazon Kinesis data stream is used for collect and process large data stream in real time. Kinesis data stream reads the data from a…Jan 18, 2023Jan 18, 2023
Published inAWS TipAWS Data Engineering — Transfer data from Database to S3 using AWS DMS.Introduction:Oct 24, 20241Oct 24, 20241
Published inAWS TipData Preparation easy and simple — AWS Glue DataBrewAt present, every organization wants to be a data driven company as all hidden gems aka business insights are extracted from the data. To…Aug 18, 2024Aug 18, 2024
Published inAWS TipAWS Data Engineering — Apache Spark in Amazon AthenaIntroductionJun 10, 2024Jun 10, 2024
Published inAWS TipAWS Data Engineering — Event Driven processing — AWS S3 + Lambda + Glue Data Catalog + AthenaEvery organization wants to be a data driven company which enable to understand their customer better way. To make the data from its raw…May 21, 2024May 21, 2024
Published inAWS TipData Engineering — S3 + SQS + Event Bridge + Lambda + Redshift ServerlessData Engineering is all about bringing different kinds of data from different sources, ingest it to a central data repository, cleaned it…May 5, 2024May 5, 2024