Python Data Engineer

2 months ago

Bangalore, India Cyitechsearch Full time

A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:


Job Description :


Responsibilities :


- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.


- Design, build, and optimize data models and schemas to support analytics and reporting requirements.


- Collaborate with data scientists and analysts to understand data needs and implement solutions that enable advanced analytics and machine learning.


- Ensure data quality and integrity throughout the data lifecycle by implementing data validation, monitoring, and governance processes.


- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.


- Continuously evaluate and adopt new technologies and tools to improve data engineering processes and efficiency.


- Troubleshoot data-related issues and performance bottlenecks in production systems.


- Document data pipelines, workflows, and technical specifications for reference and knowledge :


- Bachelors or Masters degree in Computer Science, Engineering, or related field.


- Proven experience as a data engineer or similar role, with expertise in Python programming and data manipulation libraries (e.g., pandas, NumPy).


- Strong knowledge of database systems (SQL and NoSQL) and experience with data modeling and schema design.


- Proficiency in building and optimizing ETL processes using tools like Apache Spark, Apache Airflow, or similar technologies.


- Experience working with cloud platforms such as AWS, Azure, or Google Cloud for data storage, processing, and analytics.


- Familiarity with big data technologies like Hadoop, Hive, or HBase is a plus.


- Excellent problem-solving skills and the ability to work independently or as part of a team in a fast-paced environment.


- Strong communication skills with the ability to explain complex technical concepts to non-technical stakeholders.


Skills :


- Python programming


- Data manipulation and analysis


- Database systems (SQL and NoSQL)


- ETL processes and tools


- Data modeling and schema design


- Cloud platforms (AWS, Azure, Google Cloud)


- Big data technologies


- Problem-solving

- Communication

(ref:hirist.tech)

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...

  • Data Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...

  • Data Analyst

    3 weeks ago

    bangalore, India NTT DATA Services Full time

    Req ID:  276243  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analyst - Python, PowerBI to join our team in Bangalore, Karnātaka (IN-KA), India (IN).  ...

  • Python Data Engineer

    2 months ago

    Bangalore, Karnataka, India Cyitechsearch Full time

    A Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...

  • Data Engineer

    3 weeks ago

    Bangalore, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    4 weeks ago

    Bangalore, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    4 weeks ago

    bangalore, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    5 days ago

    bangalore, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Python Data Engineer

    1 month ago

    bangalore, India Acharyaconsulting Services Full time

    Job Description :- Analyze and organize raw data to meet business needs and objectives.- Develop test and data validation frameworks using Python to ensure the quality and accuracy of data products.- Manage data, metadata, and pipeline stability to maintain a robust data infrastructure.- Collaborate with stakeholders including Product, Data, and Design...

  • Python Data Engineer

    1 week ago

    bangalore, India Acharyaconsulting Services Full time

    Job Description :- Analyze and organize raw data to meet business needs and objectives.- Develop test and data validation frameworks using Python to ensure the quality and accuracy of data products.- Manage data, metadata, and pipeline stability to maintain a robust data infrastructure.- Collaborate with stakeholders including Product, Data, and Design...

  • Python Developer

    3 weeks ago

    Bangalore, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    3 weeks ago

    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    2 months ago

    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    2 months ago

    Bangalore, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...

  • Python Developer

    2 months ago

    bangalore, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...