Big Data Engineer (SE/SSE/TL)

BigData Development Bangalore, Karnataka, India
Job Description

Location : Bangalore

Experience : 4-10 Years
Role : Big Data Engineer (SE/SSE/TL)

Educational Qualification:

B.E. / B.Tech. , M.E./M. Tech. or M. Sc. in Computer Science / Electronics Engineering / MCA

Skill Set:

Hands on programming experience in Java is must.
Candidate should have practical knowledge of object-oriented programming concepts, data structures, algorithms, multithreading, collections, concepts of garbage collection.
Conceptual understanding of Big Data concepts, relevant experience of minimum 2 years on Big Data Technologies- HDFS, s3, Spark, Spark Streaming, Kafka, Hive, Cassandra, etc is required.
Expertise in performance tuning and resource optimization techniques of spark Broadcasting, Salting, Bucketing, Partitioning, Caching, Checkpointing.
Hands-on experience with spark streaming, Data Frames and SQL API.
Well familiar with data-warehousing concepts, data modeling, metadata management, data lineage etc is desirable.
Some exposure to UI technologies is good to have.
Well familiar with distributed systems, scalable architecture and parallel computing.
Exposure to relational database like Oracle & MySQL is must.
Good understanding of source code maintenance tools and CI/CD (Continuous integration/continuous Development) pipelines.

Job Description:

As a Big data engineer you will be responsible for

Design and development of low-latency, highly-performance data analytics applications
Collaborate with peer engineers and architects on various technical projects to maintain and enhance data analytics solutions
Participate in code and design review of different application modules
Write and run comprehensive integration tests to deliver high-quality products
Capacity planning and specification of resource requirements for different deployment scenarios
Trouble-shoot and provide fix for any production bug in timely manner
Gather feedback from stakeholders for improvement in code-stack and feature-sets
Assist documentation team in providing good customer documentation, support and deployment guides
Adopt agile practice to track and update status of assigned tasks/stories

Work in India
Employment Options
Professional Experience
Skills
  • Java
  • Big Data
  • HDFS
  • S3
  • Spark
  • Spark Streaming
  • Kafka
  • Hive
  • Cassandra
Apply to Job

Company

Company Name

Talpro

Company Details

View Talpro details

Recruiter

Abhishek Kapoor

Recruitment Consultant

New Delhi, Delhi, India

View Details