Data Engineer
2 months ago
Location :- Gurgaon / Bangalore
Notice :- Immediate Joiners Only
Skills:- AWS , Spark , Python , Glue , S3 , Redshift etc..
Experience:- 4+ Years
Position Overview:
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python and DataOps tools and technologies. Knowledge of SAP HANA & Snowflake is a plus. This role is critical for designing, developing, and maintaining our client’s data pipeline architecture, ensuring the efficient and reliable flow of data across the organization.
Key Responsibilities:
Design, Develop, and Maintain Data Pipelines:Develop robust and scalable data pipelines using AWS Glue, Apache Airflow, and other relevant technologies.Integrate various data sources, including SAP HANA, Kafka, and SQL databases, to ensure seamless data flow and processing.Optimize data pipelines for performance and reliability.Data Management and Transformation:Design and implement data transformation processes to clean, enrich, and structure data for analytical purposes.Utilize SQL and Python for data extraction, transformation, and loading (ETL) tasks.Ensure data quality and integrity through rigorous testing and validation processes.Collaboration and Communication:Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.Collaborate with cross-functional teams to implement DataOps practices and improve data life cycle management.Monitoring and Optimization:Monitor data pipeline performance and implement improvements to enhance efficiency and reduce latency.Troubleshoot and resolve data-related issues, ensuring minimal disruption to data workflows.Implement and manage monitoring and alerting systems to proactively identify and address potential issues.Documentation and Best Practices:Maintain comprehensive documentation of data pipelines, transformations, and processes.Adhere to best practices in data engineering, including code versioning, testing, and deployment procedures.Stay up-to-date with the latest industry trends and technologies in data engineering and DataOps.
Required Skills and Qualifications:
Technical Expertise:Extensive experience with AWS Glue for data integration and transformation.Proficient in Apache Airflow for workflow orchestration.Strong knowledge of Kafka for real-time data streaming and processing.Advanced SQL skills for querying and managing relational databases.Proficiency in Python for scripting and automation tasks.Experience with SAP HANA for data storage and management.Familiarity with Data Ops tools and methodologies for continuous integration and delivery in data engineering.Preferred Skills:Knowledge of Snowflake for cloud-based data warehousing solutions.Experience with other AWS data services such as Redshift, S3, and Athena.Familiarity with big data technologies such as Hadoop, Spark, and Hive.Soft Skills:Strong analytical and problem-solving skills.Excellent communication and collaboration abilities.Detail-oriented with a commitment to data quality and accuracy.Ability to work independently and manage multiple projects simultaneously.
-
Senior Data Integration Engineer
2 days ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 days ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
10 hours ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Lead data engineer
2 weeks ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
AWS Data Engineer
3 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 weeks ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
2 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Senior Data Engineer
1 month ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...
-
Business Development Representative
1 day ago
Delhi, Delhi, India Hevo Data Full timeAbout Hevo DataWe are a cutting-edge data integration platform that empowers businesses to unlock the full potential of their data.Salary: $70,000 - $100,000 per annumJob DescriptionWe are seeking an exceptional Business Development Representative to join our team. As a key member of our sales organization, you will play a critical role in identifying and...
-
Senior Data Engineer
1 month ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...
-
Security Engineer
3 weeks ago
Delhi, Delhi, India NTT DATA Full timeJob OverviewNTT DATA is seeking a skilled Security Engineer to join our Managed Services team. As a Security Engineer, you will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and problems to ensure the security infrastructure and systems of our clients remain operational.Key...
-
Security Engineer
4 weeks ago
Delhi, Delhi, India NTT DATA Full timeOverviewThe Security Managed Services Engineer (L2) plays a vital role in ensuring the security of clients' infrastructures and systems under a managed service model. This role involves proactive monitoring, identifying, investigating, and resolving technical incidents and problems to restore service to clients.ResponsibilitiesSecurity Monitoring:...
-
Senior Cybersecurity Engineer
4 weeks ago
Delhi, Delhi, India NTT DATA Full timeAbout the RoleWe are seeking a skilled Security Managed Services Engineer to join our team. As a seasoned engineer, you will be responsible for providing proactive incident resolution and technical problem-solving to our clients.Your Key ResponsibilitiesConduct daily threat hunting to identify advanced threats.Analyze log sources to identify potential...
-
Senior Security Engineer
3 weeks ago
Delhi, Delhi, India NTT DATA Full timeJob OverviewThe Security Managed Services Engineer (L2) at NTT DATA plays a critical role in ensuring the security and integrity of our clients' infrastructure and systems. As a key member of our managed services team, this individual will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and...
-
Service Delivery Field Support Engineer
1 month ago
Delhi, Delhi, India NTT DATA Full timeJob OverviewNTT DATA is seeking a highly motivated and detail-oriented Service Delivery Field Support Engineer to join our team. As a key member of our support team, you will be responsible for providing technical support to clients, ensuring that their infrastructure is configured, installed, and operational.Key Responsibilities:Ensure that client...
-
Data engineer
4 weeks ago
Delhi, India Ryden Global Full timeWe're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST).Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
-
delhi, India Hevo Data Full timeHevo is hiring for a passionate Sales Development Representative with an eagle-eye view who can identify the right prospects in need of our solution to make their life easy. Job Role : You should be on top of your account book and engage with prospects. Introduce and position Hevo as a one-stop solution for all their data integration and pipeline...
-
Data Engineer
2 weeks ago
delhi, India Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST).Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
