Data Engineer/MLOps

BigData Development Tbilisi, Tbilisi, Georgia

Profile
Contacts

Summary

My experience in Data 4+ years. Besides, I worked as Data Scientist. Im interested in Data Engineering, DBA and MLOps.
Technical skills
Programming languages: Python, Scala(core level), Java(core level), PHP(core level)
CI/CD: Gitlab, Jenkins
Databases: Postgres, Oracle, ClickHouse, Greenplum, DynamoDB, MongoDB
Issue Tracking: Jira, YouTrack
Big Data: Airflow, Hadoop(Spark, Hive, Hue, ), Docker, Kafka, Flink(python), Pandas+numpy, MLFlow
Cloud: AWS
API: requests via http/https, gRPC
Docker, Kubernetes

Experience last two companies:
Apple Project(Grid Dynamics):
Responsibilities:
Create Libs for use by Data scientists in their code for feature extraction and filtering.
Create or tune appropriate MLFlow processes for deploying models in production.
Rewrite SQL on Teradata to Spark processing.

Technologies: Python, Airflow, Pandas, Spark, MLFlow
Vontier Project(Grid Dynamics):
Responsibilities:
Deploy ML models for ETL-processes
Tune AWS for deploying jobs
Optimizing ETL-processes with pandas, numpy vectorization and multiprocessing, spark

Technologies:
Python, Airflow, AWS, Pandas, Spark

11/2020 11/2021, Big Data Developer, Deeplay, Voronezh, Russia
Responsibilities:
Developing and Extending Airflow(Hooks, Operators) for ETL-processes
Developing system for alerts or notifications in slack
Optimizing query and table for ClickHouse
ETL-processes for unstructured data from different API(htttp/https, gRPC)
Developing ETL-processes for standard transfer or merge data between two sources.
Create and tune dashboads in Tableau.

Technologies:
Python, Airflow, Clickhouse, gRPC, Flink, Tableau