AWS Data Engineering
16 hours ago
Key Skills: AWS, Data Engineer
Roles and Responsibilities:
- Architect and develop data pipelines using AWS services.
- Design and optimize relational and non-relational databases.
- Implement ETL/ELT processes using AWS Glue, Lambda, and other tools.
- Manage data lakes and warehouses (e.g., S3, Redshift, Athena).
- Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.
- Ensure data quality, security, and compliance with governance standards.
- Mentor junior engineers and contribute to architectural decisions.
- Hands-on experience with AWS services: AWS Glue, Redshift, S3, Lambda, EMR, Athena, Lake Formation.
- Proficiency in Python, PySpark for data processing.
- Experience with large database migration to AWS using Database Migration tools (DMS, SCT, etc.).
- Familiarity with CI/CD pipelines and infrastructure-as-code (Terraform, CloudFormation).
- Excellent problem-solving and communication skills.
- Experience with Airflow and Step Functions is a must.
Skills Required:
- Expertise in AWS data services (Glue, Redshift, S3, Lambda, EMR, Athena)
- Strong SQL and database design knowledge (PostgreSQL, MySQL, Oracle)
- Proficient in Python and PySpark for ETL/ELT
- Experience with Airflow and AWS Step Functions
- Familiarity with AWS DMS, SCT for data migration
- CI/CD pipeline and IaC tools experience (Terraform, CloudFormation)
- Strong communication and stakeholder collaboration skills
Education: Bachelor's Degree in related field
-
Aws Engineer
13 hours ago
Kolkata, West Bengal, India Arukus Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAre you ready to be a game-changer in the world of Fintech? Arukus Technologies is at the forefront of transforming the financial landscape with cutting-edge digital solutions. As we spearhead the digital revolution in the microfinance and NBFC sectors across India and Africa, we are on the lookout for a dynamic AWS Engineer to be a vital part of our...
-
Data engineer
3 weeks ago
Kolkata, West Bengal, India AQb Solutions Pvt Ltd Full timeWe are looking for a highly skilled Data Engineer with strong expertise in Postgre SQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable Postgre SQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...
-
Aws Cloud Engineer
16 hours ago
Kolkata, West Bengal, India Vishan Business Consultancy Full time ₹ 4,00,000 - ₹ 12,00,000 per yearOur Organization is looking for an AWS Certified engineerTo designing and managing secure, scalable cloud solutions on AWSstreamlining deployments with CI/CD pipelines, optimizing cloud costs, and troubleshooting complex issues
-
Aws Cloud Engineer: Kolkata
10 hours ago
Kolkata, West Bengal, India C3 Management Consultants Full time ₹ 5,00,000 - ₹ 12,00,000 per yearAWS Certified with 1 - 4 yrs. experience as a Cloud Engineer. Immediate Joiner preferred. ONLY CANDIDATES FROM KOLKATA share cv with photo @ Required Candidate profileAWS Certified with 1- 4 yrs. experience as a Cloud Engineer. Immediate joiner preferred. ONLY CANDIDATES FROM KOLKATA share cv with photo @
-
Machine Learning Engineer
15 hours ago
Kolkata, West Bengal, India Applied Data Finance Full time ₹ 9,00,000 - ₹ 12,00,000 per yearKey Responsibilities.Collaborate with data scientists to support end-to-end ML model development, including data preparation, feature engineering, training, and evaluation.. Build and maintain automated pipelines for data ingestion, transformation, and model scoring using Python and SQL.. Assist in model deployment using CI/CD pipelines (e.g., Jenkins)...
-
Aws Data Engineer
6 days ago
Kolkata, West Bengal, India Exavalu Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole & responsibilities :Design, Develop and Test data ingestion/ETL pipelines with S3 Storage, Postgres, Athena, Redshift.Strong experience in Python, Pyspark, SQL, Glue, Lambda and orchestration techniquesDevelops stored procedures, database triggers and SQL queries with an understanding of data warehousing objects (type-2 dimensions, CDC, aggregations,...
-
Principal Data Engineer
3 weeks ago
Kolkata, West Bengal, India Xebia Full timePosition name: Principal Data EngineerExperience: 10 -14 yearsLocation - Gurugram/Chennai/Jaipur/Pune/Bhopal/BangaloreSummary of JD: AWS, Spark, Pyspark, Python, SQL, AWS, Data Warehouse design and development, Databricks and dbt, architecting and implementing workflow management systems, Airflow, Spark applications, CI/CD processes, experience with GitHub...
-
AWS Databricks Developer
1 week ago
Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole & responsibilities• Develop and maintain scalable data pipelines using Apache Spark on Databricks.• Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions.• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.• Design and implement data...
-
Azure Data Engineer
1 week ago
Kolkata, West Bengal, India Sys Edge Micro Informatics Full time ₹ 6,00,000 - ₹ 12,00,000 per yearRole & responsibilitiesAssist in data collection, cleansing, and preparation from various sources.Support basic data modeling and documentation efforts.Develop and maintain simple data pipelines using tools like Azure Data Factory (ADF).Write and optimize queries using SQL.Use Python or PySpark scripts to perform data transformations.Perform data validation...
-
Data Migration Specialist
2 weeks ago
Kolkata, West Bengal, India Axim Digitech Full timeRole : Database Migration - Design and implement solutions using indigenous database scripts and proprietary as well as third party tools like Microsoft smart bulk copy, Cosmosdb data migration tool and DMS to migrate data seamlessly across platforms in an automated manner through integrated run time environments. Plan, execute, and validate online and...