Big Data Engineer

20 hours ago

Pune, India Synechron Technologies Private Limited Full time

Job Description

As a Big Data Engineer, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will involve developing high-performance, low-latency components to run Spark clusters and collaborating with global teams to propose best practices and standards.

Technical Skills:

- Programming Languages: Strong Java experience (8+ years) with Java 1.8 or higher; solid understanding of object-oriented programming and design patterns.
- Big Data Technologies: Experience with HDFS, Hive, HBase, Apache Spark, and Kafka.
- Data Processing: Proficient in processing data using Hive, Impala, and HBase; capable of performing analysis on large data sets.
- APIs and Architecture: Experience in building self-service platform-agnostic data access APIs; knowledge of service-oriented architecture and data standards like JSON, Avro, and Parquet.
- Analytical Skills: Experience in building advanced analytical models based on business context; strong analytical and problem-solving skills.
- Development Practices: Familiarity with Agile/Scrum methodologies, SCMs like Git, and tools like JIRA; strong understanding of unit testing and SDLC activities.
- Scripting and Databases: Experience with Linux shell scripting and RDBMS/NoSQL databases; good knowledge of database principles, practices, and SQL development (preferably with Oracle).
- Performance Tuning: Experience in application performance tuning and troubleshooting in the Big Data domain.
- Other Technologies: Familiarity with cloud and container technologies, build tools such as Maven, and continuous integration tools like Jenkins or Team City is a plus.

Experience:

- 5-10 years of experience in software development, with strong Java and Big Data technology expertise.
- Demonstrated ability to design solutions and mentor other developers within the team.
- Proven experience in working with large data volumes and logical data structures.

Day-to-Day Activities:

- Translate application storyboards and use cases into functional applications.
- Design, build, and maintain reliable and efficient Java code.
- Ensure optimal performance, quality, and responsiveness of applications.
- Identify and resolve bottlenecks and bugs.
- Develop high-performance components for Spark clusters.
- Collaborate with global teams to propose best practices and standards.
- Test software prototypes and facilitate handover to the operations team.
- Process data using Hive, Impala, and HBase, and conduct analysis on large datasets.
- Mentor and guide team members in technical skills and best practices.

Qualifications:

- Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
- Optional: Familiarity with Arcadia Tool for Analytics.

Soft Skills:

- Excellent analytical and problem-solving abilities.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Ability to mentor and guide junior developers.
- Strong attention to detail and ability to work under pressure.
- Creative thinking and initiative in proposing improvements and innovations.

  • Big Data Engineer

    6 days ago

    Pune, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    6 days ago

    Pune, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines...

  • Big Data Engineer

    3 days ago

    Pune, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location:Pune/Nagpur (WFO) Experience:8 - 12 Years Employment Type:Full-time Job Overview We are looking for an experiencedBig Data Engineerwith strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED Full time

    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data environment at an enterprise scale application. You will work...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    3 days ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...