Senior Data Engineer
22 hours ago
Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob DescriptionKey Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality.Review and optimize PySpark , SQL , and Databricks code for performance, scalability, and maintainability.Offer engineering support and mentorship to data engineering teams within delivery squads, guiding them in building robust, reusable, and secure data solutions.Collaborate with architects to define data ingestion, transformation, and storage strategies leveraging Azure services such as Azure Data Factory , Azure Databricks, Azure Data LakesDrive automation and CI/CD practices in data pipelines using tools such as Git, Azure DevOps , and DBT (good to have).Ensure optimal data quality and lineage by implementing proper testing, validation, and monitoring mechanisms within data pipelines.Stay current with evolving data technologies, tools, and best practices, continuously improving standards, frameworks, and engineering methodologies.Troubleshoot complex data issues, analyse system performance, and provide solutions to development and service challenges.Coach, mentor, and support team members through knowledge sharing sessions, technical reviews.Required Skills & Experience:Developer / engineering background of large-scale distributed data processing systems (or experience in equal measure). Can provide constructive feedback based on knowledge.Proficient in designing scalable and efficient data models tailored for analytical and operational workloads, ensuring data integrity and optimal query performance.Practical experience implementing and managing Unity Catalog for centralized governance of data assets across Databricks workspaces, including access control, lineage tracking, and auditing.Demonstrated ability to optimize data pipelines and queries using techniques such as partitioning, caching, indexing, and adaptive execution strategies to improve performance and reduce costs.Programming in Pyspark (Must), SQL(Must), Python (Good to have).Experience with Databricks (Mandatory) and DBT (Good to have) is requiredImplemented cloud data technologies on either Azure (Must) other optional GCP, Azure or AWS.Knowledge around shortening development lead time and improving data development lifecycleWorked in an Agile delivery framework.
-
Senior data engineer
3 days ago
Trivandrum, India Us Technology International Private Limited Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...
-
Senior Data Engineer
2 days ago
Trivandrum, India Us Technology International Private Limited Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...
-
Senior data engineer
1 day ago
Trivandrum, India Us Technology International Private Limited Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...
-
Senior Data Engineer
2 days ago
Trivandrum, India Us Technology International Private Limited Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:- Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...
-
Senior Data Engineer
22 hours ago
Trivandrum, India Us Technology International Private Limited Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:- Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...
-
Senior Data Engineer
6 days ago
Trivandrum, India Appfabs Incorporation Full timeAbout the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...
-
Senior Data Engineer
5 days ago
Trivandrum, India Appfabs Incorporation Full timeAbout the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...
-
Senior Data Engineer
7 days ago
Trivandrum, India Appfabs Incorporation Full timeAbout the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...
-
Senior data engineer
4 days ago
Trivandrum, India Appfabs Incorporation Full timeAbout the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...
-
Senior data engineer
4 days ago
Trivandrum, India Appfabs Incorporation Full timeAbout the Project:We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You...
