Senior Data Engineer

1 week ago

Delhi, Delhi, India Integrated Wireless Solutions Full time
Exp: 8+ Years

Required Skills:
Databricks (Expert) + Pyspark (Advanced) + MongoDB (Advanced) + Scala (Understands)Notice Period:
Immediate Joiner or who can join in 15 Days MaxBudget:20-30 LPA

As a Data Engineer (Cloud Native), you will be responsible for designing, developing, and maintaining our cloud-based data infrastructure and systems.

Your primary focus will be on leveraging Azure storage, Databricks, NoSQL databases like MongoDB, and other cloud native technologies to build scalable and efficient data pipelines.

You will collaborate closely with cross-functional teams, analysts, and software engineers, to ensure optimal data flow and availability for analytics and reporting purposes.

Experience Range:8+ years of experience in relevant skills and technologies.

Responsibilities:

  • Design, develop, and maintain cloud native data infrastructure and systems using Azure storage, Databricks, NoSQL databases like MongoDB, and related technologies.
  • Develop and implement data ingestion and transformation processes to ensure efficient and accurate data flow from various sources into the data platform.
  • Develop event based pipeline that process data in real-time and apply business logics
  • Collaborate with cross-functional teams to understand data requirements and develop appropriate data models and schemas.
  • Optimize data pipelines for performance, scalability, and reliability, ensuring high availability and low latency.
  • Implement and maintain data security and privacy measures, adhering to industry best practices and compliance standards.
  • Monitor and troubleshoot data pipelines, identifying and resolving issues proactively to ensure uninterrupted data flow.
  • Work closely with analysts to understand data usage patterns and optimize data structures and schemas for analytics and reporting purposes.
  • Implement and maintain data orchestration using tools like Azure DevOps and Kubernetes, ensuring smooth deployment and management of data processes.
  • Stay up to date with the latest trends and advancements in cloud native data engineering technologies, evaluating and recommending new tools and techniques as needed.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field. A master's degree is a plus.
Extensive experience working as a Data Engineer , preferably in a cloud native environment.
Strong proficiency in Azure storage, Databricks, NoSQL databases like MongoDB, and related technologies.
Proven experience in data ingestion and transformation methods, including ETL/ELT processes.

  • Solid understanding of data modeling and schema design principles.
  • Familiarity with cloud-based deployment and orchestration tools like Azure DevOps and Kubernetes.
  • Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data engineering issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
  • Experience with Agile development methodologies is a plus.
Experience with Metadata Driven Framework is a plus.
Familiarity with Data Marketplace and Data Mesh architecture is a plus.

  • Relevant certifications in Azure or related technologies are highly desirable.

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India PrimEra Medical Technologies Full time

    Job Description: Senior Data EngineerAbout PrimEra:PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact.Position Overview:We are seeking a highly skilled Senior...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:283992NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282068NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise Integration...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India Next-Link Full time

    Job DescriptionWe are searching for a talentedSenior Data Engineerto join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical solution...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India SourceBae Full time

    Senior Data EngineerExp-6+YrsShift Time : 2 PM - 11 PMAs a Senior Data Engineer , you will:Design, Architect, and Develop solutions leveraging cloud big data technology to ingest,process and analyze large, disparate data sets to exceed business requirementsDevelop systems that ingest, cleanse and normalize diverse datasets, develop datapipelines from various...

  • Senior Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India Stebr, Inc Full time

    Company Overview:Stebr, Inc is a leading software development company committed to delivering innovative solutions that drive business success. We are seeking a skilled Google Cloud Data Engineer to join our dynamic team and help us harness the power of Google Cloud Platform (GCP) to drive our strategic initiatives.Responsibilities:Design, develop, and...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India Coders Brain Technology Pvt. Ltd. Full time

    Position: Senior Data EngineerExperience Required: 8+ yearsSalary: Market Standard or as per budgetNotice Period: ImmediateJob Type: Full-timeLocation: RemoteJob Description:Candidate should have 8+ years of experience in Data engineering, with at least 5+ years as a Big Data architect/solution architect.Proven experience as an Architect/solution architect...

  • Senior Data Engineer

    1 week ago

    Delhi, Delhi, India geektrust Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL. AWS Services : Proficient with a variety of AWS...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:285016NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."The preference here is for a good...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer MuleSoft Developer –...

  • Snowflake Data Engineer

    1 week ago

    Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Jobs For Senior Data Engineer Manager

    1 week ago

    Delhi, Delhi, India Seven Consultancy Full time

    JOB DETAILSCreate and maintain optimal data pipeline architecture,Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure...

  • Senior Lead Engineer

    1 month ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...