Data Engineer
3 weeks ago
Primary Skill - GCP + Python + SQL
OR
GCP + Java + SQL
NP - Immediate to 35 Days max
Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida
- Bachelor's degree in computer science or a related discipline
- 6+ years of applicable engineering experience
- Experience in GCP, Big Query
- Strong proficiency in Python with an emphasis in building data pipelines
- Ability to write complex SQL to perform common types of analysis and aggregations
- Experience with Apache Airflow or Google Composer
- Detail-oriented and document all the work
- Ability to work with others from diverse skill-sets and backgrounds
- GCP solution architect - Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.
- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.
- Build and maintain data ingestion processes from various sources (e.g., databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.
- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.
- Implement data security and compliance measures to ensure data integrity and privacy.
- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.
- Stay updated with the latest trends and best practices in data engineering and GCP Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.
- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.
- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.
- Strong understanding of data modeling, database design principles, and SQL.
- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.
- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.
- Excellent problem-solving and analytical skills.
- Effective communication and collaboration skills.
-
Data Architect
6 days ago
Anywhere In India/multiple Locations Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ Years Location - Remote Skills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS Cloud We are seeking a highly skilled and experienced Data Architect to join our team.The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS...
-
Sigmoid Analytics
3 weeks ago
Anywhere in India/Multiple Locations ASTAR DATA LLP Full timeJob Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...
-
Sigmoid Analytics
2 months ago
Anywhere in India,Multiple Locations ASTAR DATA LLP Full timeJob Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...
-
Aptus Data Labs
3 weeks ago
Anywhere in India/Multiple Locations Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
Aptus Data Labs
1 month ago
Anywhere in India/Multiple Locations Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
Aptus Data Labs
1 month ago
Anywhere in India/Multiple Locations, IN Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
Aptus Data Labs
3 weeks ago
Anywhere in India/Multiple Locations, IN Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
Sigmoid Analytics
2 months ago
Anywhere in India,Multiple Locations ASTAR DATA LLP Full timeThis position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...
-
Sigmoid Analytics
3 weeks ago
Anywhere in India/Multiple Locations ASTAR DATA LLP Full timeThis position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...
-
MLOps Engineer
3 weeks ago
Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
MLOps Engineer
1 month ago
Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
MLOps Engineer
1 month ago
Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
MLOps Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
Data Engineer
6 days ago
Anywhere in India/Multiple Locations BlueByte Technologies Full timePosition : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...
-
Data Engineer
6 days ago
Anywhere in India/Multiple Locations Arting Digital Full timePosition Title : Data EngineerExp : 5+ yearsLocation : RemotePrimary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : AnyRoles and responsibilities : An offshore Data Engineer to work with the Investment Analytics team. This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python. A...
-
Data Engineer
5 days ago
Anywhere in India/Multiple Locations CliqHR Full timeWork Mode : Remote (but need to do WFO after joining of 1st week)Preferred candidate profile : Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics. Excellent Data handling and strong analytical skills to collect, transform and discover...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology Pvt. Ltd. Full timePosition Name : Data Engineer (Integration) Experience Required : 10+yrs Salary : As per the Market Standard or Else whatever budget you have Notice period : Immediate joiner Job Type : Full time Location : Remote Job Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication,...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full timePosition Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full timePosition Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...
-
Data Engineer
6 days ago
Anywhere in India/Multiple Locations ARAHAS TECHNOLOGIES PRIVATE LIMITED Full timeWe are currently hiring a Pyspark Data Engineer with AWS expertise with7 years of experience Job Description :The candidate should have strong skills in Pyspark coding and have a background in AWS technologies such as Airflow Experience working with complex SQL queries Good with PySpark, Databricks, and Airflow Bachelor's or Master's degree in computer...