Python Data Engineer

2 months ago


Bangalore, Karnataka, India Cyitechsearch Full time

A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:


Job Description :


Responsibilities :


- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.


- Design, build, and optimize data models and schemas to support analytics and reporting requirements.


- Collaborate with data scientists and analysts to understand data needs and implement solutions that enable advanced analytics and machine learning.


- Ensure data quality and integrity throughout the data lifecycle by implementing data validation, monitoring, and governance processes.


- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.


- Continuously evaluate and adopt new technologies and tools to improve data engineering processes and efficiency.


- Troubleshoot data-related issues and performance bottlenecks in production systems.


- Document data pipelines, workflows, and technical specifications for reference and knowledge :


- Bachelors or Masters degree in Computer Science, Engineering, or related field.


- Proven experience as a data engineer or similar role, with expertise in Python programming and data manipulation libraries (e.g., pandas, NumPy).


- Strong knowledge of database systems (SQL and NoSQL) and experience with data modeling and schema design.


- Proficiency in building and optimizing ETL processes using tools like Apache Spark, Apache Airflow, or similar technologies.


- Experience working with cloud platforms such as AWS, Azure, or Google Cloud for data storage, processing, and analytics.


- Familiarity with big data technologies like Hadoop, Hive, or HBase is a plus.


- Excellent problem-solving skills and the ability to work independently or as part of a team in a fast-paced environment.


- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders.


Skills :


- Python programming


- Data manipulation and analysis


- Database systems (SQL and NoSQL)


- ETL processes and tools


- Data modeling and schema design


- Cloud platforms (AWS, Azure, Google Cloud)


- Big data technologies


- Problem-solving

- Communication

(ref:hirist.tech)
  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Python Developer

    2 weeks ago


    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    2 months ago


    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Acharyaconsulting Services Full time

    Job Description :- Analyze and organize raw data to meet business needs and objectives.- Develop test and data validation frameworks using Python to ensure the quality and accuracy of data products.- Manage data, metadata, and pipeline stability to maintain a robust data infrastructure.- Collaborate with stakeholders including Product, Data, and Design teams...

  • Python Data Engineer

    1 month ago


    Bangalore, Karnataka, India Acharyaconsulting Services Full time

    Job Description :- Analyze and organize raw data to meet business needs and objectives.- Develop test and data validation frameworks using Python to ensure the quality and accuracy of data products.- Manage data, metadata, and pipeline stability to maintain a robust data infrastructure.- Collaborate with stakeholders including Product, Data, and Design teams...

  • Python Expert

    2 weeks ago


    Bangalore, Karnataka, India IZMO LTD. Full time

    Immediate Joiners Preferred - This position is based in Bangalore.Job Description :Remote working is not an option, so please don't apply if you're not willing to relocate - FrogData empowers auto dealerships with advanced reporting, business insights, and predictive analytics. Our platform helps Dealer Principals, General Managers, and CFOs make...

  • Python Expert

    2 months ago


    Bangalore, Karnataka, India IZMO LTD. Full time

    Immediate Joiners Preferred - This position is based in Bangalore.Job Description :Remote working is not an option, so please don't apply if you're not willing to relocate - FrogData empowers auto dealerships with advanced reporting, business insights, and predictive analytics. Our platform helps Dealer Principals, General Managers, and CFOs make...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Mobile Programming Full time

    Salary 12 - 25 LPAPython Data EngineerJob Description :- Design, develop, and maintain database scripts and procedures to support application requirements.- Collaborate with software developers to integrate database scripts with application code.- Troubleshoot and resolve database issues in a timely manner.- Perform database maintenance tasks, such as...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India Mobile Programming Full time

    Salary 12 - 25 LPAPython Data EngineerJob Description :- Design, develop, and maintain database scripts and procedures to support application requirements.- Collaborate with software developers to integrate database scripts with application code.- Troubleshoot and resolve database issues in a timely manner.- Perform database maintenance tasks, such as...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India USET Consulting Private Limited Full time

    Job Description :About the Role :We are searching for a skilled Data Engineer to join our team and play a key role in managing our data transformation and integration pipelines. This role focuses on ensuring the smooth operation and optimization of our DBT, Airflow, and Python environment to meet the organization's data needs. The ideal candidate will be...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India USET Consulting Private Limited Full time

    Job Description :About the Role :We are searching for a skilled Data Engineer to join our team and play a key role in managing our data transformation and integration pipelines. This role focuses on ensuring the smooth operation and optimization of our DBT, Airflow, and Python environment to meet the organization's data needs. The ideal candidate will be...

  • Juego Studios

    2 weeks ago


    Bangalore, Karnataka, India Juego Studios Full time

    As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the...

  • Juego Studios

    1 month ago


    Bangalore, Karnataka, India Juego Studios Full time

    As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the...

  • Python Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Cyitechsearch Full time

    About the job : We are hiring for Python Data Engineer Experience : 5 to 7 years Work Time : IST Responsibility : - The Data Science team needs assistance with engineering around their Data Science work.- The focus is on Engineering more than Data Science.- The Data Science team is very strong, but what they need is engineering help without having to explain...

  • Python Data Engineer

    2 months ago


    Bangalore, Karnataka, India Cyitechsearch Full time

    About the job : We are hiring for Python Data Engineer Experience : 5 to 7 years Work Time : IST Responsibility : - The Data Science team needs assistance with engineering around their Data Science work.- The focus is on Engineering more than Data Science.- The Data Science team is very strong, but what they need is engineering help without having to explain...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Protiviti Full time

    JOB DESCRIPTION :- 6+ years of overall technology experience that includes at least 5+ years of hands-on data engineering utilizing the power of Python and the Apache Spark framework to design, build, and maintain data pipelines and perform large-scale data processing tasks.- Writing efficient and scalable data processing applications using PySpark APIs and...

  • Data Engineer

    1 week ago


    Bangalore, Karnataka, India Programming.com Full time

    Major Skillset : SQL, PYTHON, PYSPARK, AWSResponsibilities :- Independently prototypes/develops data solutions of high complexity to meet the needs of the organization and business customers.- Designs proof-of-concept solutions utilizing an advanced understanding of multiple coding languages to meet technical and business requirements, with an ability to...


  • Bangalore, Karnataka, India AQUASoft Full time

    About Us :AQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses.Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art technologies to build...


  • Bangalore, Karnataka, India AQUASoft Full time

    About Us :AQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses.Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art technologies to build...