Big Data Developer

2 weeks ago

GurgaonGurugram, India Rocket Consulting Full time

Big Data Engineer

Position Overview :

We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data warehouses, and analytical systems to support our organization's data-driven initiatives.

Key Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines to ingest, process, and analyze large volumes of structured and unstructured data.

- Implement data processing solutions using distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink.

- Develop and maintain ETL (Extract, Transform, Load) processes to ensure data quality and consistency across multiple sources and platforms.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.

- Optimize and tune data processing workflows for performance, scalability, and efficiency.

- Implement data security and governance best practices to ensure compliance with regulatory requirements and protect sensitive data.

- Monitor and troubleshoot data pipelines and systems, identifying and resolving issues in a timely manner.

- Stay updated with the latest technologies and trends in big data and distributed computing, evaluating and recommending new tools and frameworks as needed.

- Document design decisions, technical specifications, and operational procedures for reference and knowledge sharing.

- Provide technical guidance and mentorship to junior members of the team, fostering a culture of learning and innovation.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Big Data Engineer or similar role, with a focus on designing and implementing data processing systems.

- Proficiency in programming languages such as Java, Scala, or Python, with experience in big data frameworks and tools (e.g., Hadoop, Spark).

- Strong understanding of distributed computing principles and concepts, including parallel processing, data partitioning, and fault tolerance.

- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform for deploying and managing big data infrastructure.

- Knowledge of SQL and NoSQL databases for data storage and retrieval.

- Familiarity with data warehousing concepts and technologies (e.g., Apache Hive, Apache HBase, Amazon Redshift).

- Excellent problem-solving and analytical skills, with attention to detail.

- Effective communication and collaboration skills, with the ability to work in a team environment.

- Commitment to continuous learning and self-improvement in the field of big data and distributed computing.

(ref:hirist.tech)

  • Big Data Developer

    2 weeks ago

    gurgaon, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    3 weeks ago

    Gurugram, India Impetus Full time

    Title: Big data DeveloperType: Full-TimeLocation: GurgaonExperience: 6-9 YearsPreference - Immediate JoinersQualifications:3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and HiveGood hands-on experience of python and Bash ScriptsAble to write Glue jobs.Hands-on experience with Big Data...

  • Big Data Developer

    1 month ago

    Gurugram, India Impetus Full time

    Title: Big data Developer Type: Full-Time Location: Gurgaon Experience: 6-9 Years Preference - Immediate Joiners Qualifications: 3.5 - 9 years of good hands-on exposure with Big Data technologies – Py Spark (Data frame and Spark SQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Able to write Glue jobs. Hands-on experience with...

  • Big Data/Scala Developer

    2 weeks ago

    Gurgaon/Gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    4 weeks ago

    Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data

    1 week ago

    Gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188335 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data. Demonstrate proficiency in writing shell script and SQL queries. Hands on Exp with Oracle and DB2 databases. Must have Big Data tech stack experience Hadoop, Hive, Mapr etc. Good...

  • Big Data

    1 week ago

    gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188335 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

  • Big Data

    1 week ago

    Gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data. Demonstrate proficiency in writing shell script and SQL queries. Hands on Exp with Oracle and DB2 databases. Must have Big Data tech stack experience Hadoop, Hive, Mapr etc. Good...

  • Big Data

    1 week ago

    gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

  • Big Data Developer

    1 month ago

    gurgaon, India IntraEdge Full time

    Big Data Engineer Position Available in GurgaonWe are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners, so having...

  • Big Data Developer

    1 month ago

    Gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners, so...

  • Big Data Developer

    1 month ago

    Gurugram, India IntraEdge Full time

    🔴 Big Data Engineer Position Available in Gurgaon 🔴We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent).The candidate will work closely with the engineering team and product owners,...

  • Big Data Developer

    4 weeks ago

    gurugram, India IntraEdge Full time

    Big Data Engineer Position Available in Gurgaon We are looking for a Big Data Engineer to join our team in Gurgaon. The ideal candidate should have a Bachelor's degree in engineering or computer science (or equivalent) OR a Master's in computer applications (or equivalent). The candidate will work closely with the engineering team and product owners, so...

  • Java Big Data Developer

    1 week ago

    gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...

  • Java Big Data Developer

    2 weeks ago

    Gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...

  • Big Data Developer

    2 weeks ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    1 month ago

    gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...