Data Engineer
1 week ago
Company Description
Aecor is a UK-based software company empowering businesses worldwide with innovative, reliable, and scalable digital solutions. We partner with startups, SMEs, and large enterprises to design and develop custom software, enterprise applications, SaaS platforms, and cloud-based systems. Our focus on customer-first service, innovation, and technical excellence sets us apart as a trusted partner for digital transformation. Whether you're a growing startup or an established enterprise, Aecor delivers software solutions that drive real business impact.
Role Description
ETL & Data Integration:
- Design, develop, and manage scalable ETL pipelines using
AWS Glue (PySpark)
. - Extract data from multiple sources including
RDS MySQL
, MongoDB, internal/external APIs, and external files. - Transform, clean, and normalize data into usable formats for various downstream consumers.
- Document data flows, ETL processes, and data transformations.
Data Infrastructure & Warehousing:
- Load and manage structured data in
data lakes
(S3) and
data warehouses
(e.g.,
Amazon Redshift
). - Maintain and evolve
AWS Glue Data Catalog
, partitioning strategies, and schema versioning. - Help set up
BI/reporting platforms
(e.g., QuickSight, Tableau) by exposing curated datasets.
Data Quality & Monitoring:
- Implement
data validation
,
quality checks
, and
error handling
in ETL pipelines. - Monitor pipeline health, performance, and cost using
CloudWatch
,
Glue job metrics
, and alerts.
Security & Governance:
- Enforce secure data handling practices, including PII redaction, encryption, and access control (IAM, Lake Formation).
- Ensure compliance with
data governance policies
and
audit requirements
.
Collaboration:
- Collaborate with the AI development team to understand their data requirements and ensure the data provided is in the correct format and meets their needs.
- Assist in
data modeling
, business logic extraction, and ad-hoc data analysis as needed. - Maintain clear documentation of pipeline logic, data contracts, and transformations.
Requirements:
- 3+ years
of experience as a
Data Engineer
, preferably in a cloud-native environment. - Strong expertise in
AWS Glue
,
PySpark
, and building distributed ETL workflows. - Proficient in
Python
,
SQL
, and handling structured, semi-structured (JSON, CSV), and unstructured data. - Solid experience with
AWS services
: S3, RDS (MySQL), IAM, CloudWatch, and Redshift. - Familiarity with
data warehouse concepts
, dimensional modeling, and performance tuning. - Comfortable working with
Git
, CI/CD pipelines, and infrastructure-as-code tools like
Terraform
or
CloudFormation
. - Strong analytical and problem-solving skills; able to work independently and take ownership of data pipelines.
Nice to Have:
- Experience supporting
SageMaker, Bedrock,
AI/ML workloads
(e.g., transforming data for structured knowledge bases). - Exposure to
event-driven architectures
,
Airflow
, or
Step Functions
for orchestration. - Experience working with
streaming data
(e.g., Kinesis, Kafka).
-
Data Engineer
2 weeks ago
Vadodara, Gujarat, India Atlas Copco Group Full time ₹ 8,00,000 - ₹ 18,00,000 per yearYour roleAbout UsAtlas Copco is a Swedish multinational industrial company that was founded in 1873 headquartered in Nacka, Sweden. We are world leaders in Compressors, We also manufactur industrial tools and equipments.We are an IT Service Provider company within Atlas Copco Group called Global IT Hub (India). We are also focusing on Digital transformation...
-
Sr./Data Engineer
5 days ago
Vadodara, Gujarat, India Imriel Technology Solutions Full time ₹ 10,00,000 - ₹ 25,00,000 per yearIf you are a smart & passionate team player - then this Senior Data Engineer [Snowflake] opportunity is for youWe at IMRIEL(An Allata Company) are looking for a Senior Data Engineer to implement methods to improve data reliability and quality. You will combine raw information from different sources to create consistent and machine-readable formats. You will...
-
Senior Data Engineer
7 days ago
Vadodara, Gujarat, India Reflik Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Senior Data EngineerBasic FunctionThe Senior Data Engineer should be an expert familiar with all areas of data warehousing technical components (e.g., ETL, Reporting, Data Model), connected infrastructure, and their integrations. The ideal candidate will be responsible for developing the overall architecture and high-level design of the data...
-
Lead Data Engineer
2 weeks ago
Vadodara, Gujarat, India Asian Hires Full time ₹ 24,00,000 - ₹ 36,00,000 per yearReporting RelationshipPosition Reports To: Senior Manager Application DevelopmentDepartment: Information TechnologyPosition Location: Vadodara, Gujarat, India (Hybrid)Budget: 20,00,000 -30,00,000 PA.Job SummaryWe are seeking a strategic and technically proficient Lead Data Warehouse Engineer to architect, manage, and evolve our enterprise data warehouse....
-
Engineer-Data Science
7 days ago
Vadodara, Gujarat, India Hitachi Energy Full time ₹ 9,00,000 - ₹ 12,00,000 per yearThe opportunityHitachi Energy is currently looking for a Data Science Engineer for our Transformers of Business to join their team in Global Engineering Center in Vadodara, India. This team seeks a skilled and motivated individual. Transformers BU team leverages innovative and diverse technology to transform energy, delivering social, environmental, and...
-
Staff Data Engineer
5 days ago
Vadodara, Gujarat, India Wiser Solutions, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearCompany DescriptionWiser Solutions is a suite of in-store and eCommerce intelligence and execution tools. We're on a mission to enable brands, retailers, and retail channel partners to gather intelligence and automate actions to optimize in-store and online pricing, marketing, and operations initiatives. Our Commerce Execution Suite is available globally.Job...
-
Principal Data Engineer
4 hours ago
Vadodara, Gujarat, India Wiser Solutions, Inc. Full time ₹ 1,20,000 - ₹ 2,60,000 per yearCompany DescriptionWiser Solutions is a suite of in-store and eCommerce intelligence and execution tools. We're on a mission to enable brands, retailers, and retail channel partners to gather intelligence and automate actions to optimize in-store and online pricing, marketing, and operations initiatives. Our Commerce Execution Suite is available globally.Job...
-
Data Engineer
1 hour ago
Vadodara, Gujarat, India Paul Mason Consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey accountabilities Focuses on implementing the architect's designs by building, maintaining, and optimizing the data pipelinesand infrastructure required for data storage and processingWorks hands-on, diving deep into the code and tools to implement the data infrastructure and address day-to-day technical challenges.Writes and maintains ETL (Extract,...
-
Azure Data
2 weeks ago
Vadodara, Gujarat, India Drevol Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the RoleDrevol is building next-gen data and AI solutions on Microsoft Azurefor our global customers across IT, Retail, E-Com, Health, Pharma and Finance.We are hiring talented professionals formultiple roles under ourData & AI team. Candidates should have strong Azure expertise and passion for solving complex data challenges.Data ScientistAnalyze...
-
Material Data Engineer
5 days ago
Vadodara, Gujarat, India L&T Technology Services Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearLTTS IndiaVadodaraJob DescriptionPerform the creation, modification, and deletion of material master data.Implement data governance practices to maintain data accuracy and consistency across the SAP system.Work with cross-functional teams to integrate material master data, leveraging expertise in Materials Management (MM).Facilitate the migration of master...