Data Engineer

1 month ago

Bangalore, Karnataka, India Careerzgraph Full time

Total experience required : 15-20 years.

Notice Period - Not More then 15 Days / Only Immediate Joiners

For Location - Bengaluru (KA)/Electronic City Phase 1.


- Work from Office

Job Description :

- Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.

- Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.

- Architect robust ETL solutions to support diverse data integration needs and complex business logic.

- Translate business requirements into technical designs, ensuring solutions meet functional and performance expectations.

- Set up and oversee monitoring systems to provide production support for Data Warehouse issues, such as data load problems and transformation/translation problems.

- Thoroughly understand data transformation and translation requirements and determine the most effective tools for the job.

- Design and automate modern data pipelines using a mix of cloud-based and on-premises technologies.

- Effectively communicate complex results and technical designs to both technical and non-technical audiences, including business functional owners and stakeholders.

- Promote continuous improvement in all aspects of the team's operations.

- Perform additional duties and responsibilities as assigned to support the team's objectives.

Skills needed :

- Bachelor's Degree in Computer Science or a related field with relevant experience.

- Experience in developing SQL code in MS SQL/Oracle or other databases.

- Experience in Python scripting for data processing and ETL tasks.

- Over 10+ years of experience with ETL tools such as SSIS, ODI, SAP Data Services, Informatica or similar.

- Extensive exposure and working experience in Azure Synapse, Azure Data Factory (ADF), or similar technologies.

- Exposure to modern integration tools like Bhoomi, Celigo, Talend or similar

- Proven experience working with APIs, lambda functions, and designing complex ETLs extracting data from various sources like RDBMS, Flat files, XML, and JSON.

- Ability to analyze and optimize poorly performing queries/ETL mappings, with a strong understanding of performance tuning.

- Extensive experience with cloud services like AWS EMR, EC2, IAM, S3, and CloudFormation, as well as databases like DB2, Oracle, and Hive.

- Deep knowledge of data warehouse architectures and data modelling principles.

- Demonstrated ability to work independently and as a team leader, with a strong belief in automated testing and version control.

- Exceptional analytical, problem-solving, and communication skills, with client-facing experience.

- Proven ability to architect ETL solutions, translate business requirements into technical design, and effectively communicate with business functional owners and stakeholders.

(ref:hirist.tech)

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Staff Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Staff Engineer

    2 weeks ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Kafka Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Smartgig Technologies Private Limited Full time

    Data Engineer (6+ Years Experience)Location : Bangalore, HybridAvailability : Immediate to 15 DaysAbout the Role :We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Software Engineer

    2 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Senior Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    Immediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...