Big Data Engineer

4 weeks ago

Pune, India Synechron Technologies Private Limited Full time

Job Description

As a Big Data Engineer, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will involve developing high-performance, low-latency components to run Spark clusters and collaborating with global teams to propose best practices and standards.

Technical Skills:

- Programming Languages: Strong Java experience (8+ years) with Java 1.8 or higher; solid understanding of object-oriented programming and design patterns.
- Big Data Technologies: Experience with HDFS, Hive, HBase, Apache Spark, and Kafka.
- Data Processing: Proficient in processing data using Hive, Impala, and HBase; capable of performing analysis on large data sets.
- APIs and Architecture: Experience in building self-service platform-agnostic data access APIs; knowledge of service-oriented architecture and data standards like JSON, Avro, and Parquet.
- Analytical Skills: Experience in building advanced analytical models based on business context; strong analytical and problem-solving skills.
- Development Practices: Familiarity with Agile/Scrum methodologies, SCMs like Git, and tools like JIRA; strong understanding of unit testing and SDLC activities.
- Scripting and Databases: Experience with Linux shell scripting and RDBMS/NoSQL databases; good knowledge of database principles, practices, and SQL development (preferably with Oracle).
- Performance Tuning: Experience in application performance tuning and troubleshooting in the Big Data domain.
- Other Technologies: Familiarity with cloud and container technologies, build tools such as Maven, and continuous integration tools like Jenkins or Team City is a plus.

Experience:

- 5-10 years of experience in software development, with strong Java and Big Data technology expertise.
- Demonstrated ability to design solutions and mentor other developers within the team.
- Proven experience in working with large data volumes and logical data structures.

Day-to-Day Activities:

- Translate application storyboards and use cases into functional applications.
- Design, build, and maintain reliable and efficient Java code.
- Ensure optimal performance, quality, and responsiveness of applications.
- Identify and resolve bottlenecks and bugs.
- Develop high-performance components for Spark clusters.
- Collaborate with global teams to propose best practices and standards.
- Test software prototypes and facilitate handover to the operations team.
- Process data using Hive, Impala, and HBase, and conduct analysis on large datasets.
- Mentor and guide team members in technical skills and best practices.

Qualifications:

- Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.
- Optional: Familiarity with Arcadia Tool for Analytics.

Soft Skills:

- Excellent analytical and problem-solving abilities.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Ability to mentor and guide junior developers.
- Strong attention to detail and ability to work under pressure.
- Creative thinking and initiative in proposing improvements and innovations.

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Engineer

    4 weeks ago

    Pune, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location:Pune/Nagpur (WFO) Experience:8 - 12 Years Employment Type:Full-time Job Overview We are looking for an experiencedBig Data Engineerwith strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India FUNIC TECH PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description :Job Opening : Big Data Engineer (7-10 yrs)Location : Aundh, Pune (Work From Office)Job Type : Full-Time | General Shift | Monday FridayKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Engineer

    3 days ago

    Pune, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Big Data Engineer

    2 days ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Engineer

    1 day ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: Gaurav.2.Kumar@coforge.com For queries, contact via WhatsApp: 9667427662 Key Responsibilities:-• Design, develop, and optimize Big Data architectures...

  • Big Data Engineer

    17 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big data engineer

    17 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: Gaurav.2. For queries, contact via Whats App: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for...

  • Big Data Engineer

    20 hours ago

    Pune, India Coforge Full time

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:- • Design, develop, and optimize Big Data architectures leveraging AWS services for...