Software Development Engineer

Passively Looking

Back-End / Server Programming Bengaluru, Karnataka, India

Profile
Contacts

Summary

I have worked 2 years in Amazon as an SDE where I have worked with Java, Scala, React, Typescript and multiple AWS technologies. My detailed work experience goes as below:
Worked in Fast Data Pipelines team of Business Data Technology org, which is
a platform used by internal Amazon teams to stream data between AWS
resources and services while performing computations in between.
DataLoss Detection in Pipeline Intermediate Queues
Data Pipelines use Amazon SQS queues internally and these queues when
handling high volumes of events lose data in transmission due to data
expiration.
Designed a forward looking and multi-use case extendable solution
using scheduling frameworks and Native AWS tech stack to actively
detect the data loss in pipelines.
Lead the implementation coordinating with two peers. Used AWS Tech
- Step Functions, Lambda, ECS Fargate and SQS.
Upon deployment to production, the solution was able to detect 3% of
the data pipelines having silent data loss.
Cell Creation Automation
Designed and partly implemented the automation of data pipelines cell
creation process.
Automating majority parts of the process brought down the SDE effort
for creation of new cells from ~3 weeks to 3 days inclusive of approval
workflow.

Data Load Contract Performance Score
Devised an algorithm that calculates and gives a performance
score for the datasets involved in data load dependency graphs
across Amazons data lake. Designed and implemented a web
application that shows the score with tech stack :
ReactJS-Scala(Cradle)-DDB.
This feature gave data reliance confidence for Data Consumers. Helped
Data Producers with high scores to increase their customer base as
well.

Expectations

I am expecting to face challenging problems that puts my skills at test, with a good and supportive environment. I would like the culture of the team I am going to be in to be supportive and growth oriented.