Python Data Engineer

4 weeks ago


BangaloreHyderabadPuneMumbaiChennai, IN Swift Strategic Staff Solutions INC Full time

Job Description :


We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.

Responsibilities :

- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python scripting.

- Utilize cloud services like AWS to orchestrate and manage data pipelines efficiently.

- Possess strong database engineering skills to design and optimize data models for Snowflake.

- Leverage frameworks like Airflow or Luigi to schedule and automate data pipeline executions.

- Identify performance bottlenecks and bugs within data pipelines, then develop scalable solutions for improvement.

- Implement unit testing practices to ensure the quality and reliability of data pipelines.

- Document data pipelines thoroughly for clear understanding and future maintenance.

- Work independently and manage a pipeline of tasks with minimal supervision.

Qualifications :

- 3+ years of experience as a Data Engineer with a strong focus on Python programming.

- Expertise in working with distributed data warehouses (DW) like Snowflake and cloud services like AWS.

- Solid understanding of database concepts, data modeling principles, and data normalization techniques.

- Experience building and maintaining ETL pipelines using Python scripting and relevant frameworks.

- Proven ability to troubleshoot and debug data pipelines effectively.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

Good to Have :

- Experience with DBT (Data Build Tool) for data transformation within Snowflake.

- Familiarity with other cloud platforms like Azure or Google Cloud Platform (GCP) is a plus.

(ref:hirist.tech)
  • Data Engineer

    4 weeks ago


    Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full time

    JD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...

  • Azure Data Engineer

    2 weeks ago


    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Data Engineer

    4 weeks ago


    Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full time

    Responsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Pune/Chennai, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Big Data Engineer

    4 weeks ago


    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Data Engineer

    4 weeks ago


    Pune/Bangalore/Chennai, IN ADVANSOFT Full time

    Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...

  • AWS Data Engineer

    4 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • Data Engineer

    4 weeks ago


    Hyderabad/Bangalore/Pune/Mumbai, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Description :Technical Experience :- Experience in Data Engineering, including Data Vault Modeling, Database Architecture, and Data Architecture Principles.- Proficiency in SQL, Python, and Apache Airflow.- Familiarity with data architecture, data modeling, and machine learning concepts.- Google Cloud Platform (GCP) stack experience, including BigQuery,...

  • Data Engineer

    4 weeks ago


    Chennai/Mumbai/Pune, IN iMind Your Business Solutions Private Limited Full time

    Company Description :iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. Role Description :This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US, with offices in India. Leaders in analytics and cloud applications, headquartered in...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Platform Engineer

    4 weeks ago


    Bangalore/Chennai/Pune, IN Mobile Programming LLC Full time

    Title : Platform Engineer Location : Chennai, Bangalore, PuneExperience : 4+ years BudgetWe encourage you if you are an immediate joiner.Responsibilities :- Parse data using Python, create dashboards in Tableau.- Utilize Jenkins for Airflow pipeline creation and CI/CD maintenance.- Migrate Datastage jobs to Snowflake, optimize performance.- Work with HDFS,...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/Pune, IN Rocket Consulting Full time

    A Data Engineer/developer having good experience working withPrimary skills : Python, AirFlow - ETL skills - GCPSecondary skills : Google Cloud Composer - Google Big Query - Google Cloud- Storage - SQL - MS SQL Serve- Proven experience as a Data Engineer/Developer with expertise in Python, Airflow, and GCP.- Strong understanding of ETL concepts and best...

  • AI/ML Engineer

    4 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Azure ML Engineer

    4 weeks ago


    Bangalore/Hyderabad/Chennai/Pune, IN Notus Full time

    Azure ML EngineerOverview : The Senior Azure ML Engineer plays a crucial role in our organization, leveraging the Azure Machine Learning platform to develop, deploy, and maintain machine learning solutions. This position is essential for driving innovation and ensuring the successful implementation of machine learning models to solve complex business...

  • Data Analyst

    4 weeks ago


    Bangalore/Hyderabad/Pune/Chennai, IN Notus Full time

    Overview :The position of MMM + Python + Bayesian + Regression requires an individual with a strong foundation in data analysis and modeling. The role is crucial for leveraging statistical and machine learning techniques to provide valuable insights for decision-making within the organization.Key Responsibilities :- Develop and implement MMM models to...