Data Engineer
1 month ago
Job Title : Python GCP Data Engineer
Primary skills : Experience with Python & GCP
Secondary Skills Required :
- Knowledge on Data Warehousing on cloud-based data solutions (AWS, Azure, GCP).
Exp : 5+Years
We are seeking an experienced Python + GCP Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure on Google Cloud Platform.
Responsibilities :
- Design, develop, and maintain scalable data pipelines and infrastructure on Google Cloud Platform.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Implement data transformation, aggregation, and enrichment processes to support analytics and reporting needs.
- Optimize and tune data pipelines for performance and reliability.
- Ensure data quality and integrity throughout the data pipeline.
- Monitor and troubleshoot data pipeline issues.
- Stay up-to-date with industry trends and best practices in data engineering and cloud technologies.
Requirements :
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience working as a Data Engineer.
- Strong proficiency in Python programming language.
- Experience with Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Data Studio.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Experience with SQL and NoSQL databases.
- Knowledge of distributed computing and parallel processing frameworks such as Apache Spark.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills. (ref:hirist.tech)
-
Senior Cloud Data Engineer
1 month ago
Hyderabad,Bangalore,Chennai,Vishakhapatnam,Vizag, India Mouri Tech (P) Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, : - Minimum of 6-9 Experience with the core AWS Services and setting...
-
Senior Cloud Data Engineer
4 weeks ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...
-
Senior Azure Data Engineer
4 weeks ago
Hyderabad, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...
-
Senior Azure Data Engineer
1 month ago
Hyderabad, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...
-
Senior Azure Data Engineer
1 month ago
hyderabad, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...
-
Data Engineer
4 weeks ago
Vizag, India Miracle Software Systems Full timeThe desired candidate should have 5+ years of experience with strong knowledge of Data Storage, Data structures, Data Processing, and Data SecurityAbility to design, develop, and implement end-to-end data pipelines for efficient data extraction and transformationExperience in Workflow management using Airflow and dealing with large volumes of dataShould...
-
Fluentgrid Limited
3 weeks ago
Vishakhapatnam/Vizag, IN Fluentgrid Limited Full timeJob Title : Software Engineer/Senior Software EngineerEducation : BE/B. TechExperience Required : 2-5 YearsWork Location : VisakhapatnamJob Description :- Develop and maintain scalable and robust J2EE applications- Contribute to product innovation ideas, prototypes, functional and design specifications in addition to software development- Maintain...
-
Fluentgrid Limited
3 weeks ago
Vishakhapatnam,Vizag, India Fluentgrid Limited Full timeJob Title : Software Engineer/Senior Software EngineerEducation : BE/B. TechExperience Required : 2-5 YearsWork Location : VisakhapatnamJob Description :- Develop and maintain scalable and robust J2EE applications- Contribute to product innovation ideas, prototypes, functional and design specifications in addition to software development- Maintain...
-
Data Engineer
3 hours ago
Chennai, India NTT DATA Full timeJob Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python• 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages...
-
Aptus Data Labs
3 weeks ago
Bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Aptus Data Labs
1 month ago
bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Aptus Data Labs
4 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Data Engineer
3 hours ago
Chennai, India NTT DATA Services Full timeData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...
-
Senior Azure Data Engineer
4 weeks ago
Vizag, India Miracle Software Systems Full timeThe desired candidate should have strong knowledge of Data Storage, Data structures, Data Processing, and Data SecurityAbility to design, develop, and implement end-to-end data pipelines for efficient data extraction, transformation, and loadingShould collaborate with data scientists and analysts to implement and enhance data processing workflowsAbility to...
-
QA Engineer
4 days ago
Hyderabad, India Data Unveil Full timePosition Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...
-
QA Engineer
4 days ago
Hyderabad, India Data Unveil Full timePosition Title: QA EngineerLevel: Mid-LevelLocation: Hyderabad, Telangana.Hire Type: Full TimeStart Date: ImmediateMinimum 3+ years of QA experience in data projects.Collaborate with the Development/Business teams to understand the requirements.Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases.Ability to...
-
Data Engineer
3 weeks ago
Bangalore/Chennai/Hyderabad, India Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Data Engineer
4 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Quality Assurance Engineer
1 day ago
Hyderabad, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...
-
Data Engineer
3 weeks ago
Bangalore/Hyderabad/Chennai, India Mouri Tech (P) Ltd Full timeJob Title : Azure Data EngineerWork Location : Hyderabad , Bangalore, ChennaiExperience : 5+ yearsRequired Skills : Azure, Python, Azure DatabricksResponsibilities : . 5+ years as a data engineer.- 2- 3 years' experience in python- 2 years of experience in Azure SQL- Experience in DataBricks- Familiarity with Azure DevOps & database CI/CD.- Knowledge of...