Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Primary Roles and Responsibilities:
- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications:
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 5+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detai
-
Sigmoid Analytics
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeJob Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...
-
Sigmoid Analytics
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full timeThis position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Lancesoft India Pvt Ltd Full timeHiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Vikisol Technologies Full timeAzure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...
-
Senior/Staff Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Grorapid labs Full timeSenior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Paralleldots Full timeJob Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...
-
DevOps & Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeProfile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN BlueByte Technologies Full timePosition : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Arting Digital Full timePosition Title : Data Engineer Exp : 5+ years Location : Remote Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : Any Roles and responsibilities :- An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN CliqHR Full timeWork Mode : Remote (but need to do WFO after joining of 1st week)Preferred candidate profile :- Minimum 5+ years of work experience in Data Analysis, BI or Data Engineering roles with a quantitative degree preferably in Computer Science, Statistics or Mathematics.- Excellent Data handling and strong analytical skills to collect, transform and discover...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Innover Digital Inc. Full timeJob Description :We are actively seeking a highly skilled Senior Cloud data engineer + Databricks with expertise in other databases like Oracle, significant experience in data warehousing implementation projects, and proficiency in leveraging Azure services along with databricks/ADLS Gen2 for efficient ETL design thinking and :- Design, develop, and...
-
Data Engineering Lead
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN VAST Consulting Full timeJob Description :- Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full timeResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN SKEP IT SYSTEMS Full timeJob Description :We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...
-
Senior Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN VAST Consulting Full timeJob Description :- Should have 5+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- 5+ years of experience in a data engineering role with strong understanding of graph databases, streaming and batch analytics, cloud data platforms, data visualizations and big data processing.- Deep...
-
Data Engineer
Found in: Adzuna IN C2 - 1 day ago
Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full timeJob Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Live Connections Full timeAzure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...
-
Azure Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full timePosition : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Aricent Full timeJob Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : IT/Cloud/Data Management Job Description :- Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; candidates with substantial and relevant industry experience are also eligible- 2+ years of...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Change leaders Full timePrimary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...