Data Engineer
12 hours ago
Job Title:Data Engineer
Mandatory SkillsData Engineer, Python, AWS, SQL, Glue, Lambda, S3, SNS, ML, SQS
Job Summary:
We are seeking a highly skilled Data Engineer (SDET) to join our team, responsible for ensuring the quality and reliability of complex data workflows, data migrations, and analytics solutions across both cloud and on-premises environments. The ideal candidate will have extensive experience in SQL, Python, AWS, and ETL testing, along with a strong background in data quality assurance, data science platforms, DevOps pipelines, and automation frameworks. This role involves close collaboration with business analysts, developers, and data architects to support end-to-end testing,data validation, and continuous integration for data products. Expertise in tools like Redshift, EMR,Athena, Jenkins, and various ETL platforms is essential, as is experience with NoSQL databases, big data technologies, and cloud-native testing strategies.
Role and Responsibilities:
- Work with business stakeholders, Business Systems Analysts and Developers to ensure quality delivery of software.
- Interact with key business functions to confirm data quality policies and governed attributes.
- Follow quality management best practices and processes to bring consistency and completeness to integration service testing.
- Designing and managing the testing AWS environments of data workflows during development and deployment of data products
- Provide assistance to the team in Test Estimation & Test Planning Design, development of Reports and dashboards.
- Analyzing and evaluating data sources, data volume, and business rules.
- Proficiency with SQL, familiarity with Python, Scala, Athena, EMR, Redshift and AWS.
- No SQL data and unstructured data experience.
- Extensive experience in programming tools like Map Reduce to HIVEQL.
- Experience in data science platforms like SageMaker/Machine Learning Studio/ H2O.
- Should be well versed with the Data flow and Test Strategy for Cloud/ On Prem ETL Testing.
- Interpret and analyses data from various source systems to support data integration and data reporting needs.
- Experience in testing Database Application to validate source to destination data movement and transformation.
- Work with team leads to prioritize business and information needs.
- Develop complex SQL scripts (Primarily Advanced SQL) for Cloud ETL and On prem.
- Develop and summarize Data Quality analysis and dashboards.
- Knowledge of Data modeling and Data warehousing concepts with emphasis on Cloud/ On Prem ETL.
- Execute testing of data analytic and data integration on time and within budget.
- Work with team leads to prioritize business and information needs
- Troubleshoot & determine best resolution for data issues and anomalies
- Experience in Functional Testing, Regression Testing, System Testing, Integration Testing & End to End testing.
- Has deep understanding of data architecture & data modeling best practices and guidelines for different data and analytic platforms
Required Skills and Qualifications:
- Extensive Experience in Data migration is a must (Teradata to Redshift preferred).
- Extensive testing Experience with SQL/Unix/Linux scripting is a must.
- Extensive experience testing Cloud/On Prem ETL (e.g. Abinitio, Informatica, SSIS, Datastage, Alteryx, Glu).
- Extensive experience DBMS like Oracle, Teradata, SQL Server, DB2, Redshift, Postgres and Sybase.
- Extensive experience using Python scripting and AWS and Cloud Technologies.
- Extensive experience using Athena, EMR, Redshift, AWS, and Cloud Technologies.
- Experienced in large-scale application development testing Cloud/ On Prem Data warehouse, Data Lake, Data science.
- Experience with multi-year, large-scale projects.
- Expert technical skills with hands-on testing experience using SQL queries.
- Extensive experience with both data migration and data transformation testing.
- Extensive experience DBMS like Oracle, Teradata, SQL Server, DB2, Redshift, Postgres and Sybase.
- Extensive testing Experience with SQL/Unix/Linux.
- Extensive experience testing Cloud/On Prem ETL (e.g. Abinitio, Informatica, SSIS, Datastage, Alteryx, Glu).
- Extensive experience using Python scripting and AWS and Cloud Technologies.
- Extensive experience using Athena, EMR , Redshift and AWS and Cloud Technologies.
- API/Rest Assured automation, building reusable frameworks, and good technical expertise/acumen.
- Java/Java Script - Implement core Java, Integration, Core Java and API.
- Functional/UI/ Selenium - BDD/Cucumber, Specflow, Data Validation/Kafka, BigData, also automation experience using Cypress.
- AWS/Cloud - Jenkins/ Gitlab/ EC2 machine, S3 and building Jenkins and CI/CD pipelines, SouceLabs.
-
Azure Data Engineer
7 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
4 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Data Engineer
4 days ago
Hyderabad, Telangana, India ICE Data Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob PurposeAt Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk...
-
Azure Data Engineer With Snowflake
7 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer
4 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 8,00,000 - ₹ 24,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
2 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...
-
Property Data Engineer
10 hours ago
Hyderabad, Telangana, India ICE Data Services Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...
-
Lead/Senior Data Engineer
4 days ago
Hyderabad, Telangana, India Data Economy Full time ₹ 20,00,000 - ₹ 35,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Azure Data Engineer With Snowflake
1 week ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...