
Data Engineer
1 day ago
Company Description
Aecor is a UK-based software company empowering businesses worldwide with innovative, reliable, and scalable digital solutions. We partner with startups, SMEs, and large enterprises to design and develop custom software, enterprise applications, SaaS platforms, and cloud-based systems. Our focus on customer-first service, innovation, and technical excellence sets us apart as a trusted partner for digital transformation. Whether you're a growing startup or an established enterprise, Aecor delivers software solutions that drive real business impact.
Role Description
ETL & Data Integration:
- Design, develop, and manage scalable ETL pipelines using
AWS Glue (PySpark)
. - Extract data from multiple sources including
RDS MySQL
, MongoDB, internal/external APIs, and external files. - Transform, clean, and normalize data into usable formats for various downstream consumers.
- Document data flows, ETL processes, and data transformations.
Data Infrastructure & Warehousing:
- Load and manage structured data in
data lakes
(S3) and
data warehouses
(e.g.,
Amazon Redshift
). - Maintain and evolve
AWS Glue Data Catalog
, partitioning strategies, and schema versioning. - Help set up
BI/reporting platforms
(e.g., QuickSight, Tableau) by exposing curated datasets.
Data Quality & Monitoring:
- Implement
data validation
,
quality checks
, and
error handling
in ETL pipelines. - Monitor pipeline health, performance, and cost using
CloudWatch
,
Glue job metrics
, and alerts.
Security & Governance:
- Enforce secure data handling practices, including PII redaction, encryption, and access control (IAM, Lake Formation).
- Ensure compliance with
data governance policies
and
audit requirements
.
Collaboration:
- Collaborate with the AI development team to understand their data requirements and ensure the data provided is in the correct format and meets their needs.
- Assist in
data modeling
, business logic extraction, and ad-hoc data analysis as needed. - Maintain clear documentation of pipeline logic, data contracts, and transformations.
Requirements:
- 3+ years
of experience as a
Data Engineer
, preferably in a cloud-native environment. - Strong expertise in
AWS Glue
,
PySpark
, and building distributed ETL workflows. - Proficient in
Python
,
SQL
, and handling structured, semi-structured (JSON, CSV), and unstructured data. - Solid experience with
AWS services
: S3, RDS (MySQL), IAM, CloudWatch, and Redshift. - Familiarity with
data warehouse concepts
, dimensional modeling, and performance tuning. - Comfortable working with
Git
, CI/CD pipelines, and infrastructure-as-code tools like
Terraform
or
CloudFormation
. - Strong analytical and problem-solving skills; able to work independently and take ownership of data pipelines.
Nice to Have:
- Experience supporting
SageMaker, Bedrock,
AI/ML workloads
(e.g., transforming data for structured knowledge bases). - Exposure to
event-driven architectures
,
Airflow
, or
Step Functions
for orchestration. - Experience working with
streaming data
(e.g., Kinesis, Kafka).
-
Data Engineer
2 weeks ago
Vadodara, Gujarat, India LTIMindtree Full timeWe are hiring for AWS Data EngineerExperience - 5 to 7 YearsLocation : Chennai Notice period - immediate to 30 daysJob SummarySeeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands...
-
Data Engineer
2 weeks ago
Vadodara, Gujarat, India Forage AI Full timeExperience Level: Software Engineer- 3-5 years of relevant experience in data engineering.About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence.Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly...
-
Data Engineer
3 weeks ago
Vadodara, Gujarat, India Us Technology International Private Limited Full timeRole: Data EngineerExperience 3 -6 yearsLocation: Bangalore1.Bachelor's or master's degree in computer science, Data Science, Engineering, or a related field. 2.Proven experience in predictive modeling using Python. 3.Strong analytical and problem-solving skills. 4.Proficiency in MATLAB and Databricks. 5.Familiarity with Python libraries like Matplotlib and...
-
Data Engineer
3 weeks ago
Vadodara, Gujarat, India WovV Technologies Full timeJob Summary :WovV Technologies, a global business productivity SaaS company and recognized amongst Top 20 Global SaaS Startups is looking for Data Engineer (GIS, ArcGIS, ESRI) professionals at all levels.Permanent WFH/Remote opportunity.Skills : GIS, ArcGIS, ESRI, Python, MS SQL, Talend, Cloud.Job Title : Data Engineer (GIS, ArcGIS, ESRI).Location India :...
-
Opening for Data Engineer
2 weeks ago
Vadodara, Gujarat, India eInfochips (An Arrow Company) Full timeJob Opportunity: Data EngineerLocation: Pune /Indore/AhmedabadNotice Period: Immediate to 30 DaysWe have two open positions.1). Data Engineers with Snowflake - Snowflake, Databricks, SQL databases , PySpark, Tableau, ETL processes.2) Data Engineer -No SQL and SQL databases, DynamoDB, PowerBI, data modeling, ETL processes and data warehousing, AWS Services...
-
Data Engineer Specialist
2 weeks ago
Vadodara, Gujarat, India beBeeDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Enterprise Data Systems DeveloperThis role is a pivotal position for a skilled data engineer to contribute directly to the design and development of cutting-edge data systems.Drive Development Efforts: Contribute high-quality, scalable, and maintainable code across data pipelines, APIs, and platform components.Communicate Project Deliverables: Own the...
-
Data Engineer
1 week ago
Vadodara, Gujarat, India Allata Full time US$ 1,50,000 - US$ 2,00,000 per yearAllata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences....
-
Senior Azure Data Engineer
2 weeks ago
Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Unlock Your Data Engineering Potential with AzureJob Overview:We are seeking a highly skilled and experienced Sr. Azure Data Engineer to join our team.Key Responsibilities:Design, develop, and maintain large-scale data engineering solutions on the Azure platform using cutting-edge technologies.Develop and maintain ETL processes to integrate data from various...
-
Senior Data Engineer for Scalable Data Solutions
2 weeks ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Unlock the Power of Data Engineering in Healthcare Revenue Cycle ManagementAbout the RoleWe seek a seasoned data engineer to lead the development of a self-service data platform for reporting and analytics.The ideal candidate will design scalable data solutions using Databricks, SQL, Python, Spark, and Delta Lake on Azure.Key responsibilities include...
-
Big Data Engineer
2 weeks ago
Vadodara, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Big Data EngineerThis job posting is for a highly motivated individual with expertise in PySpark, Python, SQL, and real-time data streaming.Role Overview:This is a contract remote role that requires building, optimizing, and maintaining large-scale data processing solutions. The ideal candidate will contribute to the design and implementation of...