Data Engineer
Summary
12 years of experience in Analysis, Design, Development and Implementation of Data Warehousing and other applications using Object Oriented Analysis, Design and Methodologies.
Worked on various ETL projects involving Data Integration, Data Conversion, Data Quality by data profiling, parsing, cleansing, standardization and matching capabilities to make sure data is correct using tools like Business Objects SAP Data Services/Data Integrator, SSIS, Informatica, Talend.
Business Intelligence experience with complete life cycle Implementations using Business Objects (Supervisor, Designer, Info view, Business Objects Reporting Business Objects SDK, Xcelsius, Web-Intelligence, Publisher, BO Set Analyzer) Quicksight, Qlikview, Tableau.
Worked on data extraction, transformation and loading for different databases like Oracle, Teradata, DB2, Sybase ASE and MSSQL, Snowflake.
Designed and developed Data Marts by following Star Schema and Snowflake Schema Methodology, using industry leading Data Modeling tools like ERWIN and EMBARCADERO ER Studio.
Experience with Hadoop Ecosystem (Spark, Sqoop, Hive, Flume, Hbase, Sqoop, Kafka, oozie).
Worked on projects to migrate data from on premise databases to Redshift, RDS and S3.
Designed and engineered on-premise to off-premise CI/CD docker pipelines (integration and deployment) with ECS, Glue, Lambda, ELK, Spark databricks, firehose and kinesis stream
Used Python coding for data analysis using numpy and pandas and Big Data stacks such as pyspark.
Proficient with container systems like Docker and container orchestration like EC2 Container Service, Kubernetes, worked with Terraform.
Managed Docker orchestration and Docker containerization using Kubernetes.
Strong Experience in migrating different databases to snowflake
Experience with Snowflake Multi - Cluster Warehouses
Have extensive experience for supporting Data Extraction,transformations and loading using Informatica Power Center.
Experience with snowflake cloud data warehouse and AWS S3 bucket for integrating data from multiple source systems which include loading nested json data into snowflake tables
Participated in the development improvement and maintenance of snowflake database applications
Hands on experience with snowflake utilities,SnowSQL and SnowPipe
Responsible for Enterprise master data, metadata management, data quality, data governance
Strategy planning and implementation.
Created metadata management program with business and technical definitions and data lineage.
Expectations
Work on challenging products and use cases.
Employment Preferences
Expected Base Salary
**5,000 USD
Academic Degree
Experience
Total Professional Experience
Enterprise Experience
Contacts are hidden
Send a connection request to the candidate to get their contact details.
Contact Candidate