Big Data Engineer

7 hours ago

Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Responsibilities

  • Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases
  • Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis
  • Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions
  • Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques
  • Optimize data processing workflows for maximum performance and efficiency
  • Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems
  • Implement best practices for data governance, security, and compliance
  • Document technical designs, processes, and procedures to support knowledge sharing across teams

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 4+ years of experience as a Big Data Engineer or in a similar role
  • Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks
  • Extensive experience with programming languages such as Python, Scala, or Java
  • Knowledge of data modeling and data warehousing concepts
  • Familiarity with NoSQL databases like Cassandra or MongoDB
  • Proficient in SQL for data querying and analysis
  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration abilities
  • Ability to work independently and effectively in a fast-paced environment

Benefits
Competitive salary and benefits package.

Opportunity to work on cutting-edge technologies and solve complex challenges.

Dynamic and collaborative work environment with opportunities for growth and career advancement.

Regular training and professional development opportunities.

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Information Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Big Data EngineerKey Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets. - Collaborate with Product Management & Engineering leadership to design and implement optimal solutions. - Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks. -...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team. This individual will be responsible for designing, developing, and maintaining large-scale big data pipelines, real-time systems, and data warehouses.Required Skills and QualificationsCoding Experience: 2-5 years of experience in Java programming with a solid understanding of...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Information Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.Develop distributed data processing systems...

  • Big Data Engineering Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Big Data EngineerCome work at a place where innovation and collaboration come together to support the most exciting missions in the world.Job Description:We are seeking a talented Big Data Engineering Specialist to deliver roadmap features of our Enterprise TruRisk Platform which would help customers to measure, communicate and eliminate cyber risks...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS TCS is hiring for Big Data Location: - Chennai/Mumbai/Pune Desired Experience Range: 6 to 12 years Must-Have • PySpark • Hive Good-to-Have • Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platform Thanks Anshika