Data Engineer

2 weeks ago

Noida, India DigitalCube Consultancy Full time

Job Description : Job Title : Data EngineerExperience Required : 3-6 YearsResponsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store data from various sources.- Work with Apache Spark to process large datasets in a distributed environment, ensuring optimal performance and scalability.- Develop and optimize Spark jobs and data transformations using Scala for large-scale data processing.- Collaborate with data analysts and other stakeholders to ensure data pipelines meet business and technical requirements.- Integrate data from different sources (databases, APIs, cloud storage, etc.) into a unified data platform.- Ensure data quality, consistency, and accuracy by building robust data validation and cleansing mechanisms.- Use cloud platforms (AWS, Azure, or GCP) to deploy and manage data processing and storage solutions.- Automate data workflows and tasks using appropriate tools and frameworks.- Monitor and troubleshoot data pipeline performance, optimizing for efficiency and cost-effectiveness.- Implement data security best practices, ensuring data privacy and compliance with industry standards.- Stay updated with new data engineering tools and technologies to continuously improve the data infrastructure.Requirements :- 4 to 6 years of experience required as a Data Engineer or an equivalent role- Strong experience working with Apache Spark with Scala for distributed data processing and big data handling.- Basic knowledge of Python and its application in Spark for writing efficient data transformations and processing jobs.- Proficiency in SQL for querying and manipulating large datasets.- Experience with cloud data platforms, preferably AWS (e.g., S3, EC2, EMR, Redshift) or other cloud-based solutions.- Strong knowledge of data modeling, ETL processes, and data pipeline orchestration.- Familiarity with containerization (Docker) and cloud-native tools for deploying data solutions.- Knowledge of data warehousing concepts and experience with tools like AWS Redshift, Google BigQuery, or Snowflake is a plus.- Experience with version control systems such as Git.- Strong problem-solving abilities and a proactive approach to resolving technical challenges.- Excellent communication skills and the ability to work collaboratively within cross-functional teams.Preferred Qualifications :- Experience with additional programming languages like Python, Java, or Scala for data engineering tasks.- Familiarity with orchestration tools like Apache Airflow, Luigi, or similar frameworks.- Basic understanding of data governance, security practices, and compliance regulations. (ref:hirist.tech)

  • Network DC Build Engineer

    2 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network DC Build Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Engineer...

  • Network DC Build Engineer

    2 weeks ago

    Noida, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Network DC Build Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). ...

  • Systems Engineering Specialist

    5 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 342029NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineering Specialist -Patching/Distribution SME to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)....

  • Data engineer

    3 weeks ago

    Noida, India HCLTech Full time

    Role: Data Engineer Total years of experience: 9+ Years Location: PAN India (Any HCL office) Relevant experience for engagement: 5 Years Note: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profiles Job Description: Relevant Skills: Maintain...

  • Urgent: Automation Engineer

    2 weeks ago

    Noida, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Automation Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Internal Job Description - Senior...

  • Data Engineer

    4 weeks ago

    Noida, India HCLTech Full time

    Role: Data EngineerTotal years of experience: 9+ YearsLocation: PAN India (Any HCL office)Relevant experience for engagement: 5 YearsNote: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profilesJob Description:Relevant Skills:Maintain architecture...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Data EngineerExperience: 7 year+Location: Publicis Sapient(Pan India)Note: We need Immediate Joiner.Job Description:Primary Skills :Data Engineering – Data StreamingPython, Spark, Kafka, Spark Streaming, Databricks, Delta Lake, Azure (ADLS)We are looking for a Data Streaming Engineer to design, develop, and test real-time data pipelines leveraging...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Noida, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). At NTT DATA, we know...

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India GoodSpace AI Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position:Data EngineerExperience:2–4 YearsLocation:Onsite, NoidaEmployment Type:Full-timeWe are looking for a skilled and motivated Data Engineer with 2–4 years of experience to join our team. The ideal candidate will be responsible for building, maintaining, and optimizing scalable data pipelines and infrastructure to support business intelligence,...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    On Team Xbox, we aspire to empower the world's 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with...