Data Pipeline Development Expert
7 days ago
The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures using AWS and Azure cloud platforms. This includes:
- Designing and implementing data storage solutions using AWS S3 or Azure Blob Storage.
- Utilizing AWS Redshift or Azure Synapse Analytics to design and optimize data warehouses.
- Developing serverless data processing workflows using AWS Lambda Functions or Azure Functions.
- Creating and optimizing queries for data analysis and exploration using AWS Athena or Azure Data Explorer.
- Monitoring and managing data pipelines, databases, and infrastructure using AWS Cloud Watch or Azure Monitor.
Requirements:
- Proven experience as a Data Engineer with expertise in AWS and Azure cloud platforms.
- Proficiency in working with AWS services such as Glue, Redshift, S3, Lambda Function, Athena, Cloud Watch, EC2, IAM, and their Azure equivalents.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience in designing, building, and optimizing data pipelines and architectures.
- Understanding of data warehousing concepts and database technologies.
- Ability to troubleshoot and resolve data-related issues effectively.
- Excellent communication skills and the ability to collaborate within a team environment.
Preferred Skills:
- Certification in AWS and/or Azure cloud services.
- Familiarity with other cloud platforms and their data-related services.
- Knowledge of data governance, compliance, and best practices.
- Experience with DevOps practices in a data engineering context.
-
Cloud Data Pipeline Architect
1 day ago
Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full timeJob Requirements:We are looking for an expert Data Engineer to lead our data engineering initiatives. The ideal candidate will have 5+ years of experience in designing, building, and managing data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake. He/She will also have expertise in developing and optimizing data workflows using Scala,...
-
Enterprise Data Pipeline Architect
1 day ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeAbout the RoleWe are seeking an Enterprise Data Pipeline Architect to join our team at MWIDM Staffing Services. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing ETL processes to ingest, transform, and load data from...
-
Senior QA Analyst
7 days ago
Anywhere in India/Multiple Locations Truelancer Full timeKey Responsibilities: - Design, develop, and execute comprehensive ETL testing strategies and test plans.- Validate the accuracy and integrity of ETL data flows, ensuring end-to-end coverage.- Perform data mapping, transformations, and reconciliation validation for Talend and Snowflake pipelines.- Conduct performance testing to evaluate the efficiency of...
-
Data Science Expert
4 days ago
Anywhere in India/Multiple Locations Devlats Pvt Ltd Full timeJob Description :We are seeking a highly skilled Data Science Expert with strong expertise in Azure to join our team. The ideal candidate will have a minimum of 7 years of experience in data science, machine learning, and cloud-based AI solutions.Key Responsibilities :- Develop and deploy machine learning models using Azure ML, Databricks, and Cognitive...
-
Senior Data Pipeline Developer
4 days ago
Anywhere in India/Multiple Locations Insight Global Full timeRequirementsTo succeed as a Data Engineer at Insight Global, you will need to possess strong technical skills and experience working with big data. Key requirements include:5-7+ years of experience as a Data Engineer.Proficiency in Apache Airflow and Google Cloud Platform (GCP).Experience creating DAGs and workflows, monitoring workflows.Strong proficiency...
-
Senior Data Architecture Expert
2 days ago
Anywhere in India/Multiple Locations Cybyrotek Solutions Full timeJob Title: Senior Data EngineerAbout Us: Cybyrotek Solutions is a leading provider of cutting-edge data engineering solutions that help organizations unlock the full potential of their data.The Role: We are seeking a seasoned Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and maintaining complex data...
-
APEX Developer and Integration Expert
3 days ago
Anywhere in India/Multiple Locations XTGLOBAL INFOTECH LIMITED Full timeAbout the RoleXtglobal Infotech Limited is seeking an experienced APEX Developer and Integration Expert to join our team. As a key member of our team, you'll be responsible for designing, developing, deploying, and maintaining complex Oracle APEX Cloud applications. You'll also collaborate with stakeholders to identify business needs and translate them into...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Coders Brain Technology & Private Limited Full timeAbout the role :- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are...
-
Data Solutions Architect
1 day ago
Anywhere in India/Multiple Locations Marktine Technology Solutions Full timeAbout UsAt Marktine Technology Solutions, we are committed to delivering innovative data solutions that meet the evolving needs of our business. Our team of experts is passionate about leveraging technology to drive business outcomes and improve customer satisfaction.We are seeking a highly skilled Test Data Management Strategist to join our team. In this...
-
Data Virtualization Expert
3 days ago
Anywhere in India/Multiple Locations Risk Resources Full time**Job Overview:**Risk Resources seeks a highly skilled Data Virtualization Expert to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and maintaining data virtualization solutions using the Denodo Platform.Key Responsibilities:Design and develop data virtualization solutions using the Denodo...
-
Data Modeling Expert
5 days ago
Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time**Job Description**We are seeking a seasoned Data Modeling Expert to join our team at Screatives Software Services Pvt Ltd. The ideal candidate will have 10+ years of IT experience with a strong background in metadata management, data modeling, and data warehousing (DWH). They should have hands-on experience working with Erwin or ER Studio, strong SQL...
-
Data Analyst
3 weeks ago
Anywhere in India/Multiple Locations MWIDM Staffing Services Full timeJob Title : Data Analyst (Contractual)Location : Pan India (Hybrid Work Model)Experience : 8+ YearsAbout the Role :We are seeking a highly skilled and experienced Data Analyst to join our team on a contractual basis. The ideal candidate will have a strong foundation in data warehousing, data modeling, and data analysis techniques. This role requires a blend...
-
Big Data Solutions Expert
7 days ago
Anywhere in India/Multiple Locations Sureminds Full time**Required Skills and Qualifications**To be successful in this role, you will need to possess the following skills and qualifications:Bachelor's degree in Engineering, Computer Science, Data Science, or related field3+ years of experience in software development, data science, data engineering, ETL, and analytics reporting developmentExperience designing,...
-
Anywhere in India/Multiple Locations Synapse Tech Services Inc Full timeAbout Synapse Tech Services Inc.We are a leading technology company providing innovative solutions to businesses around the world. Our team of experts is dedicated to delivering high-quality services that meet the evolving needs of our clients.Job Summary:We are seeking a highly skilled Power BI Solutions Architect to join our team at Synapse Tech Services...
-
Enterprise Data Solutions Expert
2 days ago
Anywhere in India/Multiple Locations Live Connections Placements Private Limited Full timeJob RoleAs an Enterprise Data Solutions Expert, you will play a critical role in driving our organization's data-driven strategy forward. You will be responsible for developing and implementing data solutions that meet the evolving needs of our business.Key Responsibilities:Collaborate with data governance teams to define and implement data quality...
-
Cloud Data Architecture Expert
4 days ago
Anywhere in India/Multiple Locations Uncap Research Labs Full timeAbout the Job:We are seeking a highly skilled Data Engineer to join our team at Uncap Research Labs. In this role, you will be responsible for designing and implementing data infrastructure solutions that support our organization's goals.Main Responsibilities:Design, implement, and develop data pipelines to collect and process large amounts of data from...
-
Big Data Solutions Developer
1 day ago
Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full timeAbout the Role:We are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and managing data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake. He/She will also develop and optimize data workflows using Scala, Spark, and Python for large-scale data...
-
Full Stack Development Expert
6 days ago
Anywhere in India/Multiple Locations Arrixa Full timeJob Description:At Arrixa, we are passionate about delivering innovative solutions to our clients. As a Full Stack Development Expert, you will play a crucial role in shaping the future of our technology stack.Your primary responsibilities will include designing and implementing robust software systems, collaborating with cross-functional teams to ensure...
-
Technical Team Lead
4 weeks ago
Anywhere in India/Multiple Locations Scale AI Full timeAbout Us :Scale.AI is a cutting-edge platform that connects subject matter experts to contribute to the development of the world's most advanced Generative AI systems. We specialize in providing high-quality data to leading AI companies aiming to enhance their models' capabilities. At Outlier, we foster innovation and strive to be at the forefront...
-
Data Pipeline Specialist
7 days ago
Remote, India Fractal31 Pvt Ltd Full timeAbout UsWe are Fractal31 Pvt Ltd, a leading provider of data engineering services. Our team of experts has a proven track record of delivering high-quality solutions to our clients, and we are now looking for an experienced Data Engineer to join our team.In this role, you will be responsible for:Migrating legacy data workloads to modern cloud...