Big Data Engineer

3 weeks ago


Pune, India SGS Technical Services Pvt. Ltd Full time
Job Title: Big Data Engineer

Job Summary:

We are seeking a highly skilled Big Data Engineer to join our team at SGS Technical Services Pvt. Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.

Key Responsibilities:

  • Design and develop data processing systems using Hadoop and PySpark.
  • Implement data pipelines to process large datasets efficiently.
  • Work with data warehousing solutions to ensure proper storage and retrieval of data.
  • Perform ETL tasks and optimize performance for data ingestion and transformation.
  • Collaborate with data scientists, analysts, and other stakeholders to meet business objectives.
  • Ensure data security and integrity during processing and storage.

Requirements:

  • Strong experience with Hadoop ecosystem (HDFS, MapReduce, HBase, Hive, Pig, etc.).
  • Hands-on experience in developing and optimizing large-scale data processing using PySpark.
  • Experience with data ingestion, processing, and storage in distributed systems.
  • Knowledge of data warehousing concepts and tools.
  • Familiarity with cloud platforms like AWS, GCP, or Azure for Big Data solutions.
  • Proficiency in SQL and NoSQL databases.
  • Understanding of CI/CD pipelines for Big Data applications.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Excellent problem-solving skills and ability to handle large datasets efficiently.

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Big Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Seven N Half Full time

    Job Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...

  • Data Engineer

    3 days ago


    Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...


  • Pune, Maharashtra, India Circana Full time

    Job DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...

  • Data Engineer

    3 months ago


    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

  • Big Data Engineer

    3 weeks ago


    Pune/Maharashtra, India Talent Sketchers Full time

    Job Title: Big Data EngineerAt Talent Sketchers, we are seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Design and develop scalable data processing systems using Apache Spark.Work with various programming languages such as Java and Scala.Expertise in database modeling and working with SQL and NoSQL databases.Experience with...

  • Big Data Engineer

    1 month ago


    Pune, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...


  • Pune, Maharashtra, India Huquo Full time

    Job Title: Big Data Engineer/ManagerAbout the Role:We are seeking a highly skilled Big Data Engineer/Manager to join our team at Huquo. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key...


  • Pune, Maharashtra, India Virtusa Full time

    About the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    Job SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...

  • Big Data Engineer

    2 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Big Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...

  • Data Engineer

    4 days ago


    Pune, Maharashtra, India NR Consulting - India Full time

    Job Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    About the RoleF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...

  • Big Data Engineer

    3 weeks ago


    Pune/Gurgaon/Gurugram, India Huquo Full time

    Job Title: Big Data EngineerAt Huquo, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Spark and other big data...

  • Big Data Engineer

    3 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...

  • Big Data Engineer

    3 weeks ago


    Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full time

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...

  • Big Data Engineer

    3 weeks ago


    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and scheduling and orchestrating pipelines.Key...

  • Big data engineer

    2 days ago


    Pune, India PRI Global Full time

    Position: Sr. Big Data Engineer (Support Role) HM: Kruna Bharti Location: Pune Team/Key Projects: Play4 Initiative for Data and Analytics Duration: 12 Months Initially Domain: Banking and payment preferred YOE: 5+ Years Shift: 12 – 9 PM IST (2 – 3 hours overlap with US Team) Daily Task: Migrating data from HDFS to Ozone ...


  • Pune, Maharashtra, India Huquo Full time

    Job Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...