Big Data Developer

2 months ago

gurugram, India Rocket Consulting Full time

Big Data Engineer

Position Overview :

We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data warehouses, and analytical systems to support our organization's data-driven initiatives.

Key Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines to ingest, process, and analyze large volumes of structured and unstructured data.

- Implement data processing solutions using distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink.

- Develop and maintain ETL (Extract, Transform, Load) processes to ensure data quality and consistency across multiple sources and platforms.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.

- Optimize and tune data processing workflows for performance, scalability, and efficiency.

- Implement data security and governance best practices to ensure compliance with regulatory requirements and protect sensitive data.

- Monitor and troubleshoot data pipelines and systems, identifying and resolving issues in a timely manner.

- Stay updated with the latest technologies and trends in big data and distributed computing, evaluating and recommending new tools and frameworks as needed.

- Document design decisions, technical specifications, and operational procedures for reference and knowledge sharing.

- Provide technical guidance and mentorship to junior members of the team, fostering a culture of learning and innovation.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Big Data Engineer or similar role, with a focus on designing and implementing data processing systems.

- Proficiency in programming languages such as Java, Scala, or Python, with experience in big data frameworks and tools (e.g., Hadoop, Spark).

- Strong understanding of distributed computing principles and concepts, including parallel processing, data partitioning, and fault tolerance.

- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform for deploying and managing big data infrastructure.

- Knowledge of SQL and NoSQL databases for data storage and retrieval.

- Familiarity with data warehousing concepts and technologies (e.g., Apache Hive, Apache HBase, Amazon Redshift).

- Excellent problem-solving and analytical skills, with attention to detail.

- Effective communication and collaboration skills, with the ability to work in a team environment.

- Commitment to continuous learning and self-improvement in the field of big data and distributed computing.

(ref:hirist.tech)

  • Big Data

    3 weeks ago

    gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data.Demonstrate proficiency in writing shell script and SQL queries.Hands on Exp with Oracle and DB2 databases.Must have Big Data tech stack experience Hadoop, Hive, Mapr etc.Good Communication...

  • Big Data

    3 weeks ago

    Gurugram, India Virtusa Full time

    Big Data - Informatica Developer - CREQ188336 Description Must have 6-9 year of experience of create, design, and implement data processing jobs to transform the data. Demonstrate proficiency in writing shell script and SQL queries. Hands on Exp with Oracle and DB2 databases. Must have Big Data tech stack experience Hadoop, Hive, Mapr etc. Good...

  • Big Data Developer

    3 hours ago

    Gurugram, India Impetus Full time

    Experience Required: 4-5 yrs.Location: GurgaonImmediate Joiners onlyJOB DESCRIPTION:Skillset:Should have strong experience in big data technologies.Basic skills in data pipeline – experience in building data pipelines for data migrationBig Data – Pyspark, SparkStrong command on SQL & HiveProgramming Language: Any - Java/Python/Scala

  • Big Data Developer

    6 hours ago

    Gurugram, India Impetus Full time

    Experience Required: 4-5 yrs.Location: GurgaonImmediate Joiners onlyJOB DESCRIPTION:Skillset:Should have strong experience in big data technologies.Basic skills in data pipeline – experience in building data pipelines for data migrationBig Data – Pyspark, SparkStrong command on SQL & HiveProgramming Language: Any - Java/Python/Scala

  • Java Big Data Developer

    3 weeks ago

    gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...

  • Java Big Data Developer

    3 weeks ago

    Gurugram, India Virtusa Full time

    Java Big Data Developer - CREQ188170 Description Responsibilities include, but are not limited to - Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality Primary focus is spent writing code, API specs, conducting code reviews and testing in ongoing sprints, or doing proof of...

  • Big Data Developer

    4 weeks ago

    Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data/Scala Developer

    4 weeks ago

    Gurugram, India Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data/Scala Developer

    2 months ago

    gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    1 month ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram, India Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Big Data Developer

    1 month ago

    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

  • Senior Java Developer- Big Data Engineer

    23 hours ago

    Gurugram, India BYD Full time

    【Working Location】Gurgaon, India【Job Responsibilities】l Responsible for the architecture design of Google Cloud's big data and the application of new technologies on the platform, from both functional and non-functional perspectives. Participate in the design and implementation of architecture and products.l Manage the development of big data on...

  • Senior Java Developer- Big Data Engineer

    2 days ago

    Gurugram, India BYD Full time

    【Working Location】Gurgaon, India【Job Responsibilities】l Responsible for the architecture design of Google Cloud's big data and the application of new technologies on the platform, from both functional and non-functional perspectives. Participate in the design and implementation of architecture and products.l Manage the development of big data on...

  • Big Data/Scala Developer

    4 weeks ago

    Gurgaon/Gurugram, India Waytogo Consultants Full time

    Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Lead Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Senior Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Big Data Engineer

    24 hours ago

    gurugram, India OmegaHires Full time

    Job Title: Big Data Engineer  Duration: Full-time on OmegaHires Payroll  Location: Gurugram (Should be located near NCR to attend office for 3 days a week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...

  • Big Data Engineer

    2 weeks ago

    gurugram, India dunnhumby Full time

    We’re looking for a Big Data Engineer who expects more from their career. It’s a chance to extend and improve dunnhumby’s Data Engineering Team It’s an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers. What we expect from you • 2+ years of experience in Information...