Data Engineer
3 weeks ago
Position Overview :
As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes.
Additionally, you will leverage your expertise in AWS services and Snowflake to optimize data integration and storage in the cloud environment.
Key Responsibilities :
- Design, develop, and maintain data pipelines using Talend, AWS, and SQL to support data integration, transformation, and loading processes.
- Implement best practices for data engineering, including data modeling, schema design, and performance tuning, to ensure optimal performance and scalability.
- Collaborate with stakeholders to gather requirements and translate them into technical specifications and data solutions.
- Leverage your expertise in AWS services, including S3, EC2, Redshift, and Snowflake, to optimize data storage and processing in the cloud environment.
- Develop and maintain documentation, standard operating procedures (SOPs), and data lineage documentation to ensure transparency and compliance with data governance policies.
- Troubleshoot and resolve issues related to data pipelines, ensuring data quality and integrity throughout the data lifecycle.
- Provide technical leadership and mentorship to junior team members, and actively participate in knowledge sharing and skill development initiatives.
Required Skills and Qualifications :
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5-12 years of experience in data engineering, with a focus on Talend, AWS, and SQL.
- Must have experience with Talend, AWS, and Snowflake, with additional experience in Spark considered a plus.
- Strong analytical and problem-solving skills, with the ability to break down complex problems and implement effective solutions.
- Solid understanding of ETL concepts and hands-on experience with Talend ETL Tool (Basic & Advanced).
- Experience writing SQL queries, stored procedures, and creating marts/views in Teradata/SQL.
- Good knowledge of AWS services, particularly S3, EC2, Redshift, and Snowflake.
- Excellent communication and interpersonal skills, with the ability to work effectively in a team environment.
-
Python Data Engineer
3 weeks ago
Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full timeJob Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...
-
CGI - Data Engineer - Data Pipeline
3 weeks ago
Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full timeRequired Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...
-
AI/ML Engineer
3 weeks ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeSummary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...
-
Data Engineer
3 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Lead Data Engineer
6 days ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeWe are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...
-
Data Engineer
3 weeks ago
Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full timeJD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...
-
Azure Data Engineer
2 weeks ago
Bangalore/Hyderabad/Pune, IN Kezan Consulting Full timeWork Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...
-
Senior Data Engineer
3 weeks ago
Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...
-
Data Engineer
3 weeks ago
Mumbai/Bangalore/Chennai/Pune, IN LanceTech Solutions Full timeData Engineer - SQL, PLSQL, Snowflake, ETLWe're seeking an experienced Data Engineer with expertise in SQL, strong PLSQL skills, Snowflake, and ETL development. As a key member of our team, you'll design and implement data-driven solutions, collaborating with software developers, database architects, and data scientists. Your role involves building...
-
Senior Data Engineer
3 weeks ago
Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full timeJob Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...
-
Senior Data Engineer
3 weeks ago
Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
Lead Data Engineer
3 weeks ago
Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full timeJob Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...
-
AMAZATIC - Data Engineer/Senior Engineer - Azure
3 weeks ago
Hyderabad/Pune, IN AMAZATIC SOLUTIONS LLP Full timeSenior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong understanding...
-
AWS Data Engineer
2 weeks ago
Bangalore/Pune/Hyderabad, IN Kezan Consulting Full timeCompany Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...
-
AWS Data Engineer
14 hours ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
Data Engineer
3 weeks ago
Hyderabad/Bangalore/Pune/Mumbai, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeDescription :Technical Experience :- Experience in Data Engineering, including Data Vault Modeling, Database Architecture, and Data Architecture Principles.- Proficiency in SQL, Python, and Apache Airflow.- Familiarity with data architecture, data modeling, and machine learning concepts.- Google Cloud Platform (GCP) stack experience, including BigQuery,...
-
GCP Developer
7 days ago
Bangalore/Pune/Noida/Hyderabad/Chennai, IN Nilasu consulting Full timeJOB DESCRIPTION:Must Have: - Min 3 years' Experience with Building Pipelines using GCP-Big-Query - Min 2-3 Experience in working on Large Scale Data warehouses like Teradata - Experience building and optimizing data warehousing data pipelines (ELT and ETL), architectures and data sets. - Advanced working SQL knowledge and experience working with...
-
Big Data Engineer
3 weeks ago
Bangalore/Chennai/Pune, IN ADVANSOFT Full timeWe are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...
-
Data Engineer
3 weeks ago
Pune/Bangalore/Chennai, IN ADVANSOFT Full timeSkills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...
-
Data Engineer
3 weeks ago
Chennai/Hyderabad/Bangalore, IN HNM Solutions Full timeNote : Only immediate joinerRole : PysparkExperience : 8+ yearsLocation : Hyderabad, ChenniaInterview mode is Walkin driveRequirements :Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)1. Person should be strong in Pyspark2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework3....