Data Engineer

2 months ago

Bangalore, Karnataka, India USET Consulting Private Limited Full time

Job Description :


About the Role :


We are searching for a skilled Data Engineer to join our team and play a key role in managing our data transformation and integration pipelines. This role focuses on ensuring the smooth operation and optimization of our DBT, Airflow, and Python environment to meet the organization's data needs. The ideal candidate will be a data engineering expert with experience in Airflow, Python, and ideally, DBT.


Responsibilities :


- Configure, administer, and optimize the DBT, Airflow, and Python platform for data integration, transformation, and loading (ETL) tasks.


- Develop and maintain data pipelines using Airflow and Python to automate data processing workflows.


- Utilize DBT to manage data models and transformations (a plus).


- Leverage Snowflake and AWS services like Glue and Lambda for data storage and processing (a plus).


- Troubleshoot and resolve issues within the distributed data processing systems.


- Collaborate with the data science and engineering teams to ensure data pipelines align with technical and business requirements.


- Translate architectural solutions into efficient and robust data pipelines.


- Continuously monitor and improve the performance and scalability of the data pipelines.


- Work within an agile development framework and participate in scrum ceremonies.


Qualifications :


- 5+ years of experience in Data Engineering with expertise in data pipelines and orchestration tools.


- Proven experience with Apache Airflow and Python for data processing and workflow automation.


- Strong understanding of data engineering principles, including data modeling, ETL processes, and data quality.


- Familiarity with DBT (a plus). Experience with Snowflake and/or AWS data services (Glue, Lambda) a plus.


- Excellent problem-solving and analytical skills.


- Ability to work independently and as part of a team.


- Experience working in an agile environment and participating in scrum ceremonies.

(ref:hirist.tech)

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Aptus Data Labs

    3 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Description :We are seeking an experienced Snowflake Lead/Architect with expertise in AWS to join our dynamic team. As a Snowflake Lead/Architect, you will play a critical role in designing and implementing scalable data architectures using Snowflake within the AWS ecosystem. If you have a passion for cloud-based data warehousing and a strong understanding...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India VY Systems Pvt Ltd. Full time

    Job Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...

  • Staff Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Staff Engineer

    3 weeks ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    We are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...

  • Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Programming.com Full time

    Job Description :This is a full-time on-site role as an AWS Data Engineer located in Bengaluru. The AWS Data Engineer will be responsible for daily tasks including data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. Qualifications :- Data Engineering and Data Modeling skills- Experience with Extract Transform...

  • Kafka Data Engineer

    2 months ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Senior Data Engineer

    2 months ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Smartgig Technologies Private Limited Full time

    Data Engineer (6+ Years Experience)Location : Bangalore, HybridAvailability : Immediate to 15 DaysAbout the Role :We are seeking a highly skilled Data Engineer with over 6 years of experience to join our dynamic team in Bangalore. The ideal candidate will have extensive experience with Python and PySpark, along with a strong understanding of data engineering...

  • Data Engineer

    2 months ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Software Engineer

    4 weeks ago

    Bangalore, Karnataka, India Talent Xo Full time

    Experience Requirement :- 6 to 13 years of experience in Software Engineering, with a focus on Data and Big Data technologies.- Proven track record of designing, implementing, and maintaining data engineering solutions with high scalability and reliability.Core Skills :- Experience in Data/Big Data Engineering Technologies :- Proficiency in one or more...

  • Senior Engineer

    2 months ago

    Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full time

    Immediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...