Data Engineer
2 days ago
Responsibilities: Design & Architecture of Scalable Data Platforms Design, develop, and maintain large-scale data processing architectures (Lakehouse Platform to support business needs) Architect multi-layer data models including Bronze (raw), Silver (cleansed), and Gold (curated) layers for HRTech Domains Strong experience with any of these Snowflake, Databricks, Redshift. Leverage Delta Lake, Unity Catalog, and advanced features of Data-bricks for governed data sharing, versioning, and reproducibility. MUST have experience with AWS technologies like AWS glue, Athena, Redshift, etc. Data Pipeline Development & Collaboration Collaborate with data engineers and data scientists to develop end-to-end pipelines using Python, PySpark, SQL Performance, Scalability, and Reliability Optimize Spark jobs for performance tuning, cost efficiency, and scalability by configuring appropriate cluster sizing, caching, and query optimization techniques. Implement monitoring and alerting using Observability Platforms, Cloud-native tools Design secure architectures using Unity Catalog, role-based access control (RBAC), encryption, token-based access, and data lineage tools to meet compliance policies. Establish data governance practices including Data Fitness Index, Quality Scores, SLA Monitoring, and Metadata Cataloging. Writing PySpark, SQL, and Python code snippets for data engineering and ML tasks. Data profiling and schema inference. Stay abreast of emerging trends in Lakehouse architectures, Generative AI, and cloud-native tooling. Requirements: 8-12 years of hands-on experience in data engineering, with at least 5+ years on Python and Apache Spark. MUST have experience in migrating to data lakes from RDBMS like systems. Expertise in building high-throughput, low-latency ETL/ELT pipelines on AWS using Python, PySpark, SQL, Athena, AWS glue, Redshift, etc Excellent hands on experience with workload automation tools such as Airflow, Prefect etc. Familiarity with building dynamic ingestion frameworks from structured/unstructured data sources including APIs, flat files, RDBMS, and cloud storage Experience designing Lakehouse architectures with bronze, silver, gold layering. Strong understanding of data modelling concepts, star/snowflake schemas, dimensional modelling, and modern cloud-based data warehousing. Experience with designing Data marts using Cloud data warehouses and integrating with BI tools (Power BI, Tableau, etc.). Experience CI/CD pipelines using tools such as AWS Code commit, Azure DevOps, GitHub Actions. Knowledge of infrastructure-as-code (Terraform, ARM templates) for provisioning platform resources In-depth experience with AWS Cloud services such as Glue, S3, Redshift etc. Strong understanding of data privacy, access controls, and governance best practices. Experience working with RBAC, tokenization, and data classification frameworks
-
Data Engineer
3 weeks ago
Thiruvananthapuram, India Atica Global Full timeAbout Us:Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution. We are a startup, funded by the top investors in the country, like Titan Capital, DIBS. As innovators at the forefront of the industry, we strive to deliver the highest quality service to all our...
-
Data Engineer
3 weeks ago
Thiruvananthapuram, India Atica Global Full timeAbout Us:Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution. We are a startup, funded by the top investors in the country, like Titan Capital, DIBS. As innovators at the forefront of the industry, we strive to deliver the highest quality service to all our...
-
Data Engineer
1 week ago
Thiruvananthapuram, Kerala, India Futuremug Full timeData Engineer - Freelance InterviewerExperience: 8 to 20 YearsAbout the companyWe are an HR Tech company based in Trivandrum, offering hiring support to MNCs across India through interview, assessments and recruitment services. We have a network of 4000+ experienced professionals who take interviews in their available time slots.We're looking for experienced...
-
Data Engineer
18 hours ago
Thiruvananthapuram, Kerala, India Futuremug Full timeData Engineer - Freelance InterviewerExperience: 8 to 20 YearsAbout the companyWe are an HR Tech company based in Trivandrum, offering hiring support to MNCs across India through interview, assessments and recruitment services. We have a network of 4000+ experienced professionals who take interviews in their available time slots.Were looking for experienced...
-
Data Engineer
1 week ago
Thiruvananthapuram, Kerala, India Exact Mentoring Foundation Full timeExciting Job OpportunityLocation: ThiruvananthapuramAre you a Data Engineer/Analyst with 2-5 years of experience? Work with MSSQL, Postgres, and data warehousing. Skilled in PowerBI/BigQuery for data analysis. Expert in Microsoft SQL Server (2016 & above) and SSIS for ETL processes. Familiarity with ML technologies. Excellent communication skills for all...
-
Senior Data Engineer
3 weeks ago
Thiruvananthapuram, India Us Technology International Private Limited Full timeSenior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location: Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description – Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling,...
-
Senior Data Engineer
3 weeks ago
Thiruvananthapuram, India UST Full timeSenior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location: Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description Key Accountabilities / Responsibilities: - Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End...
-
Senior Data Engineer
3 weeks ago
Thiruvananthapuram, India Us Technology International Private Limited Full timeSenior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location: Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description – Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling,...
-
Senior Data Engineer
3 weeks ago
Thiruvananthapuram, India Us Technology International Private Limited Full timeSenior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location: Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description – Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling,...
-
Senior Data Engineer
2 days ago
thiruvananthapuram, India Us Technology International Private Limited Full timeSenior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location: Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description – Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling,...
