Senior Python Data Engineer

1 week ago

Hyderabad, Telangana, India Global Pharma Tek Full time

The Role:
We are seeking a seasoned and proficient Senior Python Data Engineer with substantial experience in cloud technologies.

As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.

The ideal candidate will possess a strong command of Python, data engineering principles, and a proven track record of successful implementation of scalable solutions in cloud environments.


Responsibilities:

Data Pipeline Development:
Design, develop, and maintain scalable and efficient data pipelines using Python and cloud-based technologies.
Implement Extract, Transform, Load (ETL) processes to seamlessly move data from diverse sources into our cloud-based data warehouse.

Cloud Integration:
Utilize cloud platforms (, Google Cloud, AWS, Azure) to deploy, manage, and optimize data engineering solutions.
Leverage cloud-native services for storage, processing, and analysis of large datasets.

Data Modelling and Architecture:
Collaborate with data scientists, analysts, and other stakeholders to design effective data models that align with business requirements.
Ensure the scalability, reliability, and performance of the overall data infrastructure on cloud platforms.

Optimization and Performance:
Continuously optimize data processes for improved performance, scalability, and cost-effectiveness in a cloud environment.
Monitor and troubleshoot issues, ensuring timely resolution and minimal impact on data availability.

Quality Assurance:


Implement data quality checks and validation processes to ensure the accuracy and completeness of data in the cloud-based data warehouse.

Collaborate with cross-functional teams to identify and address data quality issues.

Collaboration and Communication:
Work closely with data scientists, analysts, and other teams to understand data requirements and provide technical support.
Collaborate with other engineering teams to seamlessly integrate data engineering solutions into larger cloud-based systems.

Documentation:
Create and maintain comprehensive documentation for data engineering processes, cloud architecture, and pipelines.

Technical Skills:

Programming Languages:
Proficiency in Python for data engineering tasks, scripting, and automation

Data Engineering Technologies:
Extensive experience with data engineering frameworks like distributed data processing.
Understanding and hands-on experience with workflow management tools like Apache Airflow.

Cloud Platforms:
In-depth knowledge and hands-on experience with at least one major cloud platform: AWS, Azure, or Google Cloud.
Familiarity with cloud-native services for data processing, storage, and analytics.

ETL Processes:
Proven expertise in designing and implementing Extract, Transform, Load (ETL) processes

SQL and Databases:
Proficient in SQL with experience in working with relational databases (, PostgreSQL, MySQL) and cloud-based database services

Data Modeling:
Strong understanding of data modeling principles and experience in designing effective data models

Version Control:
Familiarity with version control systems, such as Git, for tracking changes in code and configurations

Collaboration Tools:
Experience using collaboration and project management tools for effective communication and project tracking

Containerization and Orchestration:
Familiarity with containerization technologies (, Docker) and orchestration tools (, Kubernetes)

Monitoring and Troubleshooting:
Ability to implement monitoring solutions and troubleshoot issues in data pipelines.
Data

Quality Assurance:
Experience in implementing data quality checks and validation processes

Agile Methodologies:
Familiarity with agile development methodologies and practices

Soft Skills:
Strong problem-solving and critical-thinking abilities.
Excellent communication skills, both written and verbal.
Ability to work collaboratively in a cross-functional team environment.
Attention to detail and commitment to delivering high-quality solutions.

  • Senior Python Data Engineer

    1 week ago

    Hyderabad, Telangana, India Evnek Technologies Pvt Ltd Full time

    Job Description We are looking for a highly skilled Python Data Engineer with extensive experience in Databricks and Python to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining data infrastructure and pipelines, ensuring data quality, and enabling data-driven decision-making across the organization.Design,...

  • Python Developer

    4 weeks ago

    Hyderabad, Telangana, India AIFALABS Full time

    Job Description :Python Develoer : AIFA India is Seeking a Full-Time Strong Python Developer (Onsite)Are you fascinated by the power of data to unlock insights and drive innovation? Do you excel in Python development, data analysis, and engineering solutions? If harnessing data to propel AI and machine learning projects forward excites you, AIFA India...

  • Python Developer

    4 weeks ago

    Hyderabad, Telangana, India AIFALABS Full time

    Job Description :Python Develoer : AIFA India is Seeking a Full-Time Strong Python Developer (Onsite)Are you fascinated by the power of data to unlock insights and drive innovation? Do you excel in Python development, data analysis, and engineering solutions? If harnessing data to propel AI and machine learning projects forward excites you, AIFA India...

  • Python Support Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:280182NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Python Support Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Candidate 4+...

  • Python Support Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:280182NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Python Support Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Candidate 4+...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "Data Engineer...

  • Big Data Engineer, Data Modeling

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Modeling

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Dun & Bradstree Full time

    A senior data engineer's role involves the development of new applications for major projects to drive significant revenue and cost savings for Dun and Bradstreet. Senior data engineers are expected to delve into new, cutting-edge technologies to explore new markets and opportunities. Senior data engineers are expected to react quickly to high-tech...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Dun & Bradstree Full time

    A senior data engineer's role involves the development of new applications for major projects to drive significant revenue and cost savings for Dun and Bradstreet. Senior data engineers are expected to delve into new, cutting-edge technologies to explore new markets and opportunities. Senior data engineers are expected to react quickly to high-tech...

  • Python Support Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Python Support Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Candidate 4+ year of Support...

  • Data Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Data Engineer Responsibilities-Create...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India RandomTrees Full time

    We are hiring: Senior Data EngineerIf you are someone with 8 to 10 years of experience as a Data Engineer, this might be the perfect opportunity for you!Location: HyderabadWhat we are looking for:Proficiency in PythonStrong SQL skillsExperience with at least one cloud platform (AWS, Azure, GCP)Good communication and presentation skills

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India DAZN Full time

    We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. You will play a pivotal role in developing complex data pipelines and...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India DAZN Full time

    We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. You will play a pivotal role in developing complex data pipelines and...

  • Big Data Engineer, Data Analysis

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at , I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing product...

  • DAZN - Data Engineer - SQL/Python

    4 weeks ago

    Hyderabad, Telangana, India Dazn Software Private Limited Full time

    Job Description :We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. You will play a pivotal role in developing complex data...

  • DAZN - Data Engineer - SQL/Python

    4 weeks ago

    Hyderabad, Telangana, India Dazn Software Private Limited Full time

    Job Description :We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. You will play a pivotal role in developing complex data...

  • DAZN - Data Engineer - SQL/Python

    1 week ago

    Hyderabad, Telangana, India Dazn Software Private Limited Full time

    Job Description :We are seeking a highly skilled and experienced Senior Data Engineers to be the backbone of our Data Science and Software Engineering teams. The ideal candidate will possess a strong foundation in programming fundamentals, expert-level knowledge of SQL, Python, and Apache Spark. You will play a pivotal role in developing complex data...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India LTIMindtree Full time

    Senior Data EngineerJob Req Id: Bachelor's Degree in Computer Science or a related discipline 5+ years of applicable engineering experience Experience in GCP, Big Query Strong proficiency in Python with an emphasis in building data pipelines Ability to write complex SQL to perform common types of analysis and aggregations Experience with Apache Airflow or...