Sr Software Engineer

BigData Development San Francisco, California, United States

Profile
Contacts

Summary

Over 9+ years experience in developing codes and procedures for applications in different environments in Finance, Web & Big Data field.
Over 8+ years experience in building analytics pipelines with Spark, Kafka, Hive, Parquet/Avro.
AWS Solutions Architect Certified professional.
Advanced knowledge of NoSQL & RDBMS, SQL queries, Database sharding and partitioning,
Working knowledge of Software Development process, like Scrum and Agile.
Advanced knowledge of Software Design Patterns, Big Data Technologies (Apache Hadoop, Flume, Kafka, Storm, Spark & Spark Streaming) and Cloud Technologies & design.
Expert knowledge of Spark Streaming, Batch processing and DataFrames using Spark & Spark SQL.
Knowledge of Multithreading, thread synchronization & Spring MVC.
Technical expertise in Batch & Stream processing using Flume, Kafka, Storm & Spark, HDFS, HBase and Hive.
Strong understanding of Hadoop and Spark internals.
Experience in designing Microservice architecture and orchestration.
Good understanding of API design & architecture to enable multiple services communicate with each other.
Experience using Maven, SBT & Ant build tools.
Strong fundamentals in AWS and containerization tools like Docker, Kubernetes.
Excellent analytical, problem solving and communication skills.

Expectations

Looking to be a part of a dynamic Software Engineering team that focuses on building distributed/scalable/low latency services and applications/frameworks