Data Engineer candidate in Bangalore, Karnataka, India

Summary

Company Name Area of Expertise & Key Highlights
Senior Data engineer Hands-on experience with AWS tools like Glue,Lambda,pyspark and redshift.
Expertise in ETL by using cloud technologies.

Played a key role in migrating data applications to AWS resulting in $1M cost savings
Executed end to end data pipeline from transactional DB to analytical Redshift environment on AWS.
Migrated current state informatica jobs to Cloud leveraging Glue and EMR based Apache PySpark/SparkSQL jobs.
Assisted in building ingestion framework to extract from Oracle, SQL Server to AWS data lake built on S3.
Implemented data lake zone concepts with 3 layers to house raw, refined, and aggregated datasets.
Delivered HUDI framework on EMR to account for slowly changing dimensions.
Built complex data pipelines to process large data sets (50B+) from heterogeneous transactional systems to data lake, and finally to data warehousing environment.
Python (including popular libraries like Pandas, NumPy, and SQLAlchemy)
Python Data Processing Frameworks (e.g., Apache Spark with Python, Dask)
Expertly integrated data from various sources using Python, including databases, APIs, and external data providers, ensuring data accuracy, consistency, and timeliness.

Data engineer Contribute to data engineering and business intelligence needs
Partner with stakeholders across the business unit to get requirements and priorities.
Migrate on prem ETLs from data stage to PySpark jobs using EMR and Glue services
Built, enhance data pipelines to support data transformations needed for BI team using PySpark.
Provided architectural design for the data model, and created an ETL transformation for converting and ingesting new data marts- TPC Mart for Transmission data, and Value mart for inventory data.
Designed complex mappings for date chaining and deduping before loading the data into target database.
Created PL/SQL packages, functions, stored procedures, triggers, and materialized views to implement business logic in Oracle database.
Identified performance issues in sources, targets, and mappings by analyzing the data flow, evaluating transformations, and tuned accordingly for better performance.
Developed Audit process to identify and resolve data synchronization issues between source and target systems.
Promoted reusability of the code by created parameters and variables.
Optimized end to end ETL pipeline by removing performance bottlenecks.
Leveraged Map Reduce for the event driven ETL transformations.
Collaborated closely with data scientists and analysts to design and implement Python-based data models that supported complex analytical queries and reporting needs.
Junior data engineer Work with business analysis to decipher complex data requirements and coordinate with ETL team on implementation.
Written sql scripts to test and validate ETL transformations.
Assisted in designing the end-to-end ETL workflows to deliver the end user BI requirements.
Ensured Python-based data compliance, resulting in zero data breaches or compliance violations during my tenure.

.
FP & A Manager Capex & Opex Validations & Business Partnering
- Support and review the preparation of the business cases prepared by the Network Team and Sales Team, covering all commercial decisions, thereby ensuring that business decisions are made within the Organization governance framework.
- Track, monitor & analyze actual performance against business case approvals & highlight the discrepancies, if any.
- MIS on business cases approved & monitoring the actual utilization over approved CAPEX & OPEX.
- Flash the product-wise revenue report to the regional head on monthly basis and highlight the revenue trend on month on month basis.
- Drive variance analysis thereby highlighting the variance of actual costs Vs budgeted and forecasted costs.

MIS Manager Marketing Annual and Monthly P&L Review
- Drawing annual P&L with the support of sales and spends plans & monitoring the status of actuals on monthly basis in order to identify misses and track an action plan to ensure that annual P&L and sales plan is met.
- Working with sales & distribution teams on improving gross contribution (GC) by publishing various dash boards (GC Matrix & product profitability/ mix analysis) and conducing discussions on GC Improvement.
- Monitoring of excess/ non-moving inventory, loss of business because of pendency, near expiry stock etc. to ensure lower inventory with minimum loss of sale. Inventory has been brought down to 30 days and significant reduction of non-moving stock This resulted in saving in working capital.
Zonal Performance Review
- Monthly MBR with Zonal Head and National Head and tracking action items for further implementation at field level to ensure ground level implementation
- Publish sales dashboard & marketing expense analysis dashboard on monthly basis to BU head which gives a bird eye view of the performance of entire zone. - Publish dashboard on ROI of marketing spends. This has resulted in turning back proposals which have lower ROI
- Business partnering through identifying exceptions at zonal/ region level in comparison with all India, study with the help of marketing team & derive action plan for further action.
Regional Performance Review
- Publishing regional flash which provides Birds eye view to the leadership team to focus exceptions at each region/ territory level.
- Conducting state/ region business reviews along with marketing head on regular basis across 15 mini regions to identify actionable areas, improvement areas of business & achieve top line as well as bottom line targets.
Secondary Sales Analysis, Performance Audits
- Explored new business opportunities & new channels for increasing sales & margin.
- Market visits to understand the voice of the customer, competition policies w.r.t. Finance & other activities and give feedback to management on further points of action.
Business Monitoring & Controls
- Streamlined the discounted rate business by setting in place monthly audit mechanism, review of exception quantities/ rates at the counters through data analytics, maintaining the database.

ArticleShip Exposure - Auditing (Statutory and Internal audit of corporate and non-corporate entities), Preparation and Finalization of Balance Sheet, Profit & Loss Account Compliance of Accounting Standards.
-Preparation of Audit Program and Team Management of the audit team for varied types of audit assignments and co-ordination with the audit team and with clients.
- Exposed to various types of industries like manufacturing, transport, software, construction, industrial service, Educational Institutions, and film Production.
- Assistance to needy clients in compliance of procedural requirements relating to incorporation of companies
- Filing of various Forms / Documents with Ministry of Company Affairs
- Preparation and finalization of draft Audit Reports in connection with Branch Audit, Long Form Audit Report and Tax Audit Report.