Lead Data Engineer

1 week ago

Hyderabad, Telangana, India Foundation AI Full time

Designation :
Lead Data Engineer (Individual Contributor)

Reporting to :
Sr Tech Lead

Key Responsibilities :

  • Architect and Design Data Systems : Design and develop scalable data pipelines and systems to manage large volumes of structured and unstructured data.
  • Data Pipeline Development : Develop scalable endtoend ETL (Extract, Transform, Load) data pipelines to ingest data from various diverse sources, perform transformations, and load data into target systems to meet both functional and nonfunctional requirements.
  • Data Modeling and Optimization : Develop and optimize data models (including relational Data) for efficient storage and retrieval, ensuring data quality and integrity.
  • Technical Oversight : Manage technical scope, ensuring alignment with business objectives and delivering highquality solutions. Provided required technical guidance and oversight to various crossfunctional teams and team members on databases like PostgreSQL/ Vector DB and various queries, functions, and datasets.
  • Configuration Management : Manage the configurations for various tools and databases like postgresDB, vectorDB, etc. for both onpremises and cloud platforms for optimized performance and redundancy
  • Performance Tuning: Monitor and optimize data pipelines, SQL/queries, functions, procedures, and triggers for performance and scalability.
  • Stakeholder Collaboration: Work closely with crossfunctional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver solutions ensuring alignment with organizational goals.
  • Promoting Best Practices: Define and promote reusable, scalable, and maintainable solutions, emphasizing software engineering best practices and continuous improvement.
  • Communication: Communicate effectively at all levels about the importance of solution design, conducting technical walkthroughs to ensure a clear understanding of system architecture.
  • Continuous Improvement: Work with data and analytics experts to enhance functionality in data systems and products, driving improvements and growth within the data team.
  • Cloud Experience: Experience of working with AWS RDS databases is preferred

Required Experience, Skills & Qualifications :
Experience : 5-7 years in High-Performance Data Products or Data Systems as a Data Architect/Engineer.

Technical Skills :
Proficiency in orchestration tools like Airflow.

  • Proficiency in SQL and relational databases (e.g., PostgreSQL, Aurora) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Good knowledge of Vector database like pgvector etc.
  • Handson experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).
  • Experience with agile development methodologies (e.g., Scrum, Kanban).
  • Software Engineering: Proficient in software engineering best practices, unit testing, integration testing, and tools like Git and Docker.
  • Security and Compliance: Familiarity with security compliances and design practices.
  • Communication: Exceptional interpersonal, analytical, and communication skills. Ability to explain and discuss concepts with colleagues and teams effectively.
  • CI/CD Pipeline: Fully adhere to and promote an entire CI/CD pipeline.
  • API Development: Familiarity with API development and data formats like JSON/XML.

Desired Experience, Skills & Qualifications :

  • Domain Experience: Experience in the Insurance/Legal domain is a plus.
  • Regulatory Knowledge: Familiarity with security and privacy regulations such as GDPR and HIPAA.
  • Collaboration: Proven ability to collaborate effectively with crossfunctional teams in a fastpaced environment.
  • Problem Solving: Demonstrated ability to conduct root cause analyses and drive continuous improvement initiatives.
)

  • Big Data Engineer, Data Modeling

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Modeling

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Analysis

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at , I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing product...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "Data Engineer...

  • Data Lead

    3 days ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Lead – SAP Sales and Distribution to join our team in [[Hyderabad]], [[Telangana]], [[India]].8+ of Overall experience...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:277204NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Once You Are...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer Responsibilities-Create...

  • Data Engineering Lead

    1 week ago

    Hyderabad, Telangana, India Chryselys Full time

    Job Description:As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding of...

  • Lead Data Engineer

    1 week ago

    Hyderabad, Telangana, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID:279798NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we are:NTT...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). At...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in hyderabad, Telangana (IN-TG), India (IN).Who we are: NTT DATA...

  • Tableau Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:284210NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Tableau Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Data Engineer...

  • Tableau Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Tableau Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Position Overview ...

  • Lead Data Engineer

    1 week ago

    Hyderabad, Telangana, India Foundation AI Full time

    Designation : Lead Data Engineer (Individual Contributor)Reporting to : Sr Tech LeadKey Responsibilities : Architect and Design Data Systems : Design and develop scalable data pipelines and systems to manage large volumes of structured and unstructured data. Data Pipeline Development : Develop scalable endtoend ETL (Extract, Transform, Load) data pipelines...

  • Data Migration Technical Team Lead

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:284993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Migration Technical Team Lead to join our team in Hyderabad, Telangana (IN-TG), India...

  • Digital Engineering Lead Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). At NTT DATA, we know...