Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Primary Skill - GCP + Python + SQL
OR
GCP + Java + SQL
NP - Immediate to 35 Days max
Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida
- Bachelor's degree in computer science or a related discipline
- 6+ years of applicable engineering experience
- Experience in GCP, Big Query
- Strong proficiency in Python with an emphasis in building data pipelines
- Ability to write complex SQL to perform common types of analysis and aggregations
- Experience with Apache Airflow or Google Composer
- Detail-oriented and document all the work
- Ability to work with others from diverse skill-sets and backgrounds
- GCP solution architect - Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.
- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.
- Build and maintain data ingestion processes from various sources (e.g., databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.
- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.
- Implement data security and compliance measures to ensure data integrity and privacy.
- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.
- Stay updated with the latest trends and best practices in data engineering and GCP Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.
- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.
- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.
- Strong understanding of data modeling, database design principles, and SQL.
- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.
- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.
- Excellent problem-solving and analytical skills.
- Effective communication and collaboration skills.
-
Sigmoid Analytics
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeJob Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...
-
Sigmoid Analytics
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeThis position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Lancesoft India Pvt Ltd Full timeHiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Vikisol Technologies Full timeAzure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...
-
Senior/Staff Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Grorapid labs Full timeSenior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Paralleldots Full timeJob Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...
-
DevOps & Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeProfile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN BlueByte Technologies Full timePosition : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Arting Digital Full timePosition Title : Data Engineer Exp : 5+ years Location : Remote Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : Any Roles and responsibilities :- An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN CliqHR Full timeWork Mode : Remote (but need to do WFO after joining of 1st week)Preferred candidate profile :- Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics.- Excellent Data handling and strong analytical skills to collect, transform and discover...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Innover Digital Inc. Full timeJob Description :We are actively seeking a highly skilled Senior Cloud data engineer + Databricks with expertise in other databases like Oracle, significant experience in data warehousing implementation projects, and proficiency in leveraging Azure services along with databricks/ADLS Gen2 for efficient ETL design thinking and :- Design, develop, and...
-
Data Engineering Lead
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN VAST Consulting Full timeJob Description :- Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full timeResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN SKEP IT SYSTEMS Full timeJob Description :We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...
-
Senior Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN VAST Consulting Full timeJob Description :- Should have 5+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- 5+ years of experience in a data engineering role with strong understanding of graph databases, streaming and batch analytics, cloud data platforms, data visualizations and big data processing.- Deep...
-
Data Engineer
Found in: Adzuna IN C2 - 1 day ago
Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full timeJob Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Live Connections Full timeAzure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full timePosition : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Aricent Full timeJob Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : IT/Cloud/Data Management Job Description :- Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; candidates with substantial and relevant industry experience are also eligible- 2+ years of...