Senior Data Engineer

7 days ago

Bengaluru, India East Vantage Full time

Position : Senior Data EngineerLocation : Bengaluru, India (Work From Anywhere)Job Type : Full-timeJob Summary :We are seeking an experienced Senior Data Engineer to design, build, and maintain robust data infrastructure and scalable pipelines. The ideal candidate will have deep expertise in AWS-based data platforms, big data technologies, and data architecture to effectively support our analytics and machine learning initiatives. This role requires advanced proficiency in Python and SQL to automate workflows and ensure high data quality and security across the organization.Key Responsibilities :- Data Pipeline Development : Design, develop, and maintain highly scalable and efficient data pipelines utilizing core AWS services such as S3, Glue, Lambda, and RDS.- ETL/ELT Processes : Build robust ETL (Extract, Transform, Load) or ELT processes to efficiently ingest, transform, and store large volumes of data for consumption.- Database Management : Manage and optimize relational databases (e.g., PostgreSQL, MySQL) to ensure performance, scalability, and integrity, supporting evolving business requirements.- Automation & Workflow : Automate complex data workflows and processing tasks using advanced scripting in Python, SQL, and Bash.- Data Quality & Governance : Implement thorough data validation, monitoring, and governance best practices to ensure high data quality and integrity across all systems.- DevOps & Infrastructure : Implement DevOps and CI/CD practices for data pipelines using tools like Terraform (for Infrastructure as Code) and GitHub Actions.- Data Enablement : Enable data accessibility and facilitate insights generation by preparing data structures for BI tools such as Tableau or Metabase.- Cross-Functional Collaboration : Collaborate effectively with analysts, data scientists, and other cross-functional teams to translate complex business needs into effective and scalable data solutions.Qualifications :- Experience : Proven experience as a Senior Data Engineer (46+ years suggested by skill depth).- Cloud Expertise : Strong background and hands-on experience with AWS-based data platforms (S3, Glue, Lambda, RDS).- Programming Proficiency : Advanced proficiency in Python for scripting, automation, and data transformation logic.- Database Skills : Strong SQL skills and proven experience with database management (PostgreSQL, MySQL, etc.).- Data Architecture : Solid grasp of ETL/ELT development principles and building efficient data pipelines.- IaC & DevOps : Experience using Infrastructure as Code tools like Terraform or CloudFormation, and familiarity with CI/CD workflows and Git version control.- Data Quality : Strong commitment to data quality, security, and governance best practices.Preferred Skills :- Machine Learning : Exposure to ML technologies such as SageMaker.- BI Tools : Familiarity with BI tools like Tableau or Metabase for reporting and visualization.- Agile Experience : Experience working in Agile/Scrum environments with tools like Jira and Confluence.- Testing : Familiarity with automated testing methodologies for data pipelines. (ref:hirist.tech)

  • Senior Data Engineer cum Data Scientist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Senior Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Data Engineer Senior Consultant

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Senior Data Scientist

    4 weeks ago

    Bengaluru, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    3 hours ago

    Bengaluru, Karnataka, India IC Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Data Scientist (Remote Sensing)About the jobSagri Inc. is a pioneering social impact startup founded in 2018 with the vision of "realizing the coexistence of humanity and the earth." We utilize satellite data and AI technology to address global food crises and climate change challenges. Our core products - Actaba, Detaba, and Sagri - offer innovative...

  • Data Entry Operator

    2 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...