Data Engineer
1 day ago
Requirements :
- Strong proficiency in writing complex, optimized SQL queries (especially for Amazon Redshift).
- Experience with Apache Spark (preferably on AWS EMR) for big data processing.
- Proven experience using AWS Glue for ETL pipelines (working with RDS, S3 etc. ).
- Strong understanding of data ingestion techniques from diverse sources (files, APIs, relational DBs).
- Solid hands-on experience with Amazon Redshift : data modeling, optimization, and query tuning.
- Familiarity with AWS Quicksight for building dashboards and visual analytics.
- Proficient in Python or PySpark for scripting and data transformation.
- Understanding of data pipeline orchestration, version control, and basic DevOps.
Good-to-have Skills :
- Knowledge of other AWS services (Lambda, Step Functions, Athena, CloudWatch).
- Experience with workflow orchestration tools like Apache Airflow.
- Exposure to real-time streaming tools (Kafka, Kinesis, etc. ).
- Familiarity with data security, compliance, and governance best practices.
- Experience with infrastructure as code (e. g., Terraform, CloudFormation).
Key Responsibilities :
- Develop, maintain, and optimize complex SQL queries, primarily for Amazon Redshift, ensuring high performance and scalability.- Build and manage ETL pipelines using AWS Glue, processing data from various sources including RDS, S3, APIs, and relational databases.
- Utilize Apache Spark (preferably on AWS EMR) for large-scale data processing and transformation tasks.
- Design efficient data models and optimize Redshift clusters for storage, query performance, and cost-effectiveness.
- Create and maintain data ingestion workflows from diverse sources such as files, APIs, and databases.
- Develop scripts and data transformations using Python or PySpark.
- Implement and monitor data pipeline orchestration with version control and adhere to DevOps best practices.
- Collaborate with analytics and BI teams, leveraging AWS QuickSight for dashboarding and visualization.
- Ensure data quality, security, and compliance throughout the data lifecycle.
-
Data Engineer
1 week ago
Multiple Locations, India Jade Business Services (JBS) Full time ₹ 5,00,000 - ₹ 12,00,000 per yearDescription : - Role: Data Engineer (AI Knowledge Base Platform) - Experience: 4 years to 7 years - Work location: Anywhere in India (Remote) - Notice period: Immediate to 15 days - Shift timing: 3:00 PM to 12:00 AM (IST) We are seeking a Data Engineer to design and maintain the ingestion, processing, and transformation pipelines that...
-
Data Engineer
3 days ago
Multiple Locations, India InCommon Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are seeking hands-on Data Engineers with strong data migration experience and exposure to diverse database systems.Responsibilities : - Migrate ETL pipelines and plugins from Fivetran into Nexla/Snowflake. - Build automation for ingestion, transformation, and observability. - Deliver under tight deadlines in a fast-paced environment. - This is a...
-
Data Engineer
2 weeks ago
Multiple Locations, India Dash Hire Full time ₹ 8,00,000 - ₹ 25,00,000 per yearDescription : The Data Engineer will be responsible for designing, developing, and maintaining the data infrastructure for a healthcare organisation. The ideal candidate will have experience in working with healthcare data, including EHR, HIMS, PACS, and RIS. They will also have experience with SQL, Elasticsearch, and data integration tools like Talend....
-
Data Engineer
5 days ago
Multiple Locations, India BIG IT JOBS Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition Summary : We are seeking a skilled Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our...
-
Data Engineer
5 days ago
Multiple Locations, India Kane Solutions Full time ₹ 10,00,000 - ₹ 15,00,000 per yearJob Description : This is a full-time remote role for a Data Engineer at Kane Solutions. We are seeking a detail-oriented and analytical professional with strong command over Python, SQL, and data analysis to join our growing teamRole and Responsibilities : - Write efficient and clean Python scripts for data extraction, transformation, and processing ...
-
Data Engineer
2 weeks ago
Multiple Locations, India iTheme Consulting Full time ₹ 6,00,000 - ₹ 18,00,000 per yearPosition Overview We are seeking a skilled and proactive Data Engineer to join our growing Data & Analytics team. This role is critical to our enterprise-wide data transformation journey, enabling scalable, secure, and high-quality data pipelines that power analytics, governance, and decision-making across the organization. The Data Engineer will work...
-
Lead Data Engineer
2 weeks ago
Multiple Locations, India CAPITALNUMBERS INFOTECH LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per yearSenior Data Engineer We are seeking a highly skilled Senior Data Engineer to strengthen and optimize our data infrastructure, which serves as the backbone of our business operations. The ideal candidate will bring deep technical expertise in data engineering, with hands-on experience across PostgreSQL, AWS (Redshift, S3), Apache Airflow, and dbt, and a...
-
Lead Data Engineer
2 weeks ago
Multiple Locations, India Hunarstreet Technologies Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearResponsibilities : - Own the architecture and roadmap for scalable, secure, and high-quality data pipelines and platforms. - Lead and mentor a team of data engineers while establishing engineering best practices, coding standards, and governance models. - Design and implement high-performance ETL/ELT pipelines using modern Big Data technologies for...
-
Senior Data Engineer
2 weeks ago
Multiple Locations, India Digihelic Solutions Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : We are seeking a highly experienced and technically adept Senior Data Engineer to join our TAVS team in Pune. The ideal candidate will have a minimum of 12 years of relevant experience and a strong background in designing, developing, and optimizing large-scale data pipelines and data warehouse solutions. This role requires deep expertise...
-
Data Engineer III
3 days ago
Multiple Locations, India YO IT CONSULTING Full time ₹ 15,00,000 - ₹ 25,00,000 per yearProfile - Data EngineerExperience - 5-8 yearsLocation - HyderabadWork Mode - Contractual (Remote)Duration - 3 monthsMust Have - Python, Databricks, Pyspark. Roles & Responsibilities : We are currently seeking a highly motivated Data Engineer III with experience in Healthcare Domain This role collaborate closely with product teams, software engineers...