Data Engineer
3 days ago
Key Responsibilities :
- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.
- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.
- Develop and implement data validation and testing processes to ensure that data is processed accurately and efficiently.
- Automate data collection, processing, and reporting processes to minimize manual work and improve efficiency.
- Create high quality documents to capture problem statements, requirements, solutions and designs.
- Contribute to the development of reusable, repeatable collateral for use across the practice.
- Implement data quality checks and validation processes to ensure the accuracy, consistency, and security of data.
- Monitor data pipelines and processes, troubleshoot issues, and implement solutions to prevent recurrence
- Maintain comprehensive documentation of data architectures, processes, and workflows to facilitate knowledge sharing and collaboration.
Qualifications :
Key Requirements :
Must Have :
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3-5 years of experience in data engineering
- Excellent problem-solving, organization, debugging, and analytical skills.
- Ability to work independently and in a team environment.
- Excellent communication skills for effectively expressing ideas to team members and clients.
- Understanding of relational database concepts and SQL.
- Hands on experience in one RDBMS (MSSQL/MySQL/PostgreSQL)
- Knowledge of cloud computing platforms, such as Amazon Web Services (AWS), Google Cloud Platform (GCP), or Microsoft Azure
- Hands on Experience in Data processing frameworks such as Apache Spark/Beam/Flink
- Experience in building data pipelines using orchestration tools or equivalent cloud services like Apache Airflow or NiFi, as well as ETL tools such as Azure Data Factory, AWS Glue, Matillion, or similar platforms.
- Hands on Experience with any one of data warehousing solutions, such as Snowflake/ Google BigQuery, or Databricks
- Debug and optimize existing data infrastructure and processes as needed.
- Experience with at least one programming language, such as Python/ Java
Nice To Have :
- Experience building large-scale, high throughput, 24x7 data systems.
- Any Data engineering certifications on any of the clouds
- Experience with Visualization tools, such as Power BI, Looker, Tableau, and QuickSight.
- Experience in designing, implementing, and managing event-driven data pipelines using Kafka or similar cloud-native streaming services like AWS Kinesis, Azure Event Hubs, or Google Cloud Pub/Sub.
- Exposure to machine learning algorithms, AI, and/or LLM, with implementation in practice.
- Experience with legacy data systems (e.g. Hadoop, Informatica).
- Experience in Migrating Data Engineering workloads from on-prem to cloud or between clouds
- Experience in GCP Data services is preferred
-
Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations Risk Resources LLP Full timeOverview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Sureminds Full timeAs a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations Insight Global Full timePosition : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Patch Infotech Private Limited Full timeKey Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations CA-One Tech Cloud Full timeJob Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...
-
Data Engineer
7 days ago
Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Title : Data Engineer - DBTExperience : 5 - 8 YearsLocation : GurgaonNotice period : 15 DaysJob Type : FTE/C2HWork Mode : RemoteJob Responsibilities : - Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS- Requirements definition, source data analysis and profiling, the logical...
-
Senior Data Engineer
3 days ago
Anywhere in India/Multiple Locations Appizion Consulting And Solutions Full timeAbout the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines to support critical business decisions. You will work closely with data scientists, analysts, and engineers to build and...
-
Data Engineer Lead
6 days ago
Anywhere in India/Multiple Locations BLJ TECH GEEKS Full timeOverview of BLJ TECH GEEKS: A leading organization in the field of data engineering, seeking a skilled professional to join our team. We are looking for an experienced Data Engineer Lead who can lead complex projects from start to finish, ensuring timely delivery and high-quality results.Job Description:Beyond the core responsibilities of a Data Engineer,...
-
Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations Stratsol Software Systems Pvt Ltd Full timeJob Summary : We are looking for a skilled Data Engineer with expertise in Snowflake to join our team. As a Data Engineer, you will be responsible for building and managing scalable data pipelines, integrating data from various sources, and optimizing our data warehouse infrastructure. Skills Required : - Data Engineering : Snowflake, SQL, ETL- Data...
-
Data Engineer Innovator
6 days ago
Anywhere in India/Multiple Locations Sureminds Full time**Job Overview**We are seeking a highly skilled Senior Data Engineer to join our team at Sureminds. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data architectures that provide critical insights to our business stakeholders.In this role, you will collaborate closely with...
-
Data Engineering Specialist
7 days ago
Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description:MLOPS SOLUTIONS PRIVATE LIMITED is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing Snowflake-based analytics solutions on AWS. Your expertise in data engineering, architecture, and development will help us build efficient data pipelines and data management...
-
Senior Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations RLS Associates Full timeSenior Data Engineer No. of Years : 12 - 15 yearsWork location : Anywhere in IndiaWork Mode : RemoteWork Type : Full time to Divit Technology Solutions Pvt. Ltd.Job Description :A software engineer in the role of data engineering role must be : - Proficient in designing, developing and testing code to build data infrastructure and pipeline processes for...
-
Data Engineering Specialist
12 hours ago
Anywhere in India/Multiple Locations Cybyrotek Solutions Full timeJob Title: Senior Data EngineerCompany Overview: Cybyrotek Solutions is a leading technology company that specializes in providing innovative data engineering solutions to its clients.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations/India Techiebutler Full timeJob Title : Senior Data Engineer. Employment Type : Full-Time. Experience Required : 5+ Years. About Us : At Techiebutler, we pride ourselves on creating impactful data solutions that power innovative businesses. We are searching for a highly-skilled Senior Data Engineer who thrives in a collaborative environment and brings expertise from working in...
-
Data Science Engineer
6 days ago
Anywhere in India/Multiple Locations Valiance Analytics Pvt. Ltd. Full timeAbout UsValiance Analytics Pvt. Ltd. is a global leader in AI & Data analytics, empowering clients to build cutting-edge technology solutions for digital transformation.We work with top brands across industries to deliver transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IoT analytics, and more. Our team...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology & Private Limited Full timeAbout the role :- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are...
-
Senior Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations Uncap Research Labs Full timeKey Responsibilities :- Lead and drive discovery sessions with external clients and build state-of-the-art data architectures. - Work with stakeholders to understand their problem statements, data requirements and implement solutions that meet their needs.- Design, implement, and develop data pipelines to collect and process large amounts of data from...
-
Engineering Lead
5 days ago
Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full timeWe are seeking an experienced Engineering Lead - Data Processing to lead our efforts in building and maintaining cutting-edge big data processing systems. As a key member of our engineering team, you will be responsible for overseeing the design, implementation, and maintenance of our big data infrastructure, ensuring seamless integration with existing...
-
Senior Data Engineering Manager
8 hours ago
Anywhere in India/Multiple Locations Aventior Digital Private Limited Full timeAbout the RoleWe are looking for a highly skilled Senior Data Engineering Manager to lead our data engineering team. The successful candidate will have extensive experience in designing and implementing large-scale data ingestion processes, as well as expertise in ETL tools such as SSIS and Azure Data Factory.Key Responsibilities:Manage and lead a team of...
-
Senior Data Engineer Position
3 days ago
Anywhere in India/Multiple Locations Appizion Consulting And Solutions Full timeData Engineering Role Overview:In this role, you will be responsible for designing, developing, and maintaining data infrastructure that enables data-driven insights and innovation. You will work closely with data scientists, analysts, and engineers to build and maintain data infrastructure that supports business growth.