Data Engineer
4 weeks ago
Position : Data engineer
Location : Remote/ Hybrid
Must have - AKS, Python and SQL
Good to have - Erwin tool
Job Description :
seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with Azure services, and proficiency in managing Kubernetes clusters. This role will primarily focus on designing, implementing, and maintaining data pipelines, ensuring scalability, reliability, and performance for our data-driven applications.
Responsibilities :
- One of this role need to have Data modeling experience. Team uses- Erwin tool for data modeling and database design.
- Strong in SQL and Python (must)
- Design, develop, and deploy scalable data pipelines on AKS for processing and analyzing large volumes of data.
- Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Implement best practices for data ingestion, transformation, and storage using Azure services and Kubernetes.
- Optimize data pipelines for performance, reliability, and cost-effectiveness.
- Monitor and troubleshoot data pipelines to ensure smooth operation and timely resolution of issues.
- Implement security measures and compliance standards to protect sensitive data.
- Stay updated with the latest technologies and trends in data engineering and AKS ecosystem.
- Document technical designs, processes, and procedures for knowledge sharing and future reference.
- Work directly with business
Requirements :
- Proven experience as a Data Engineer with hands-on experience in designing and implementing data pipelines.
- Proficiency in Azure services, including Azure Kubernetes Service (AKS)
- Strong knowledge of Kubernetes concepts and experience in managing Kubernetes clusters.
- Experience with containerization technologies such as Docker.
- Proficiency in programming languages such as Python for data processing and automation.
- Strong communication and interpersonal skills with the ability to collaborate effectively in a team environment
-
Aptus Data Labs
6 days ago
Anywhere in India/Multiple Locations, IN Aptus Data Labs Full timeRole - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...
-
MLOps Engineer
6 days ago
Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Lancesoft India Pvt Ltd Full timeHiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...
-
Senior/Staff Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Grorapid labs Full timeSenior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Paralleldots Full timeJob Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...
-
Data Engineer
7 days ago
Anywhere in India/Multiple Locations, IN Perfecthire Full timeJob Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...
-
DevOps & Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeProfile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timePrimary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full timeResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN SKEP IT SYSTEMS Full timeJob Description :We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...
-
Machine Learning Engineer
6 days ago
Bangalore/Anywhere in India/Multiple Locations, IN Aptus Data Labs Full timeML Engineer-Video AnalyticsLocation- Bangalore/RemoteWe are seeking a talented and experienced ML Engineer worked on Video Analytics to join our Data Science team. The ideal candidate will be responsible for developing and implementing machine learning algorithms to analyze and extract insights from video data. This role offers the opportunity to work on...
-
Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations, IN AAR Consultancy Full timeTechnical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...
-
Data Engineer
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full timeJob Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...
-
Azure Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full timePosition : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Change leaders Full timePrimary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN Aricent Full timeJob Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : IT/Cloud/Data Management Job Description :- Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; candidates with substantial and relevant industry experience are also eligible- 2+ years of...
-
Lead Data Engineer
1 week ago
Anywhere in India/Multiple Locations, IN Vista Full timeAbout you :- Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write quality...
-
Cloudsufi - GCP Data Engineer - SQL/BigQuery
4 weeks ago
Anywhere in India/Multiple Locations, IN Cloudsufi India Private Limited Full timeAbout Us :CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We partner...
-
Senior Data Engineer
6 days ago
Anywhere in India/Multiple Locations, IN Rigel Networks Pvt.Ltd Full timeRole Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...
-
Data Engineer
4 days ago
Anywhere in India/Multiple Locations, IN Mobile Programming LLC Full timeData EngineerExp - 4-7 yearsLocation - RemoteNotice period - Immediate OnlyMandatory skill : Python, Airflow, Spark, AWS, SQLKey Responsibilities :Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Python, Airflow, and Spark.Data Integration: Integrate data from various sources into a cohesive and consistent format...