Reply - Data Engineer - Python/Spark

12 hours ago


Cochin, Kerala, India VALOREM PVT LTD Full time

Description :


- Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems.

- Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience implementing Big Data with Advanced Analytics solutions.

- Successful candidates will have experience and skill in providing solutions for storing, retrieving, transforming and aggregating data to support line of business applications as well as reporting systems.

- The Data Engineer will work with customers to deliver solutions utilizing strong business, technical and data modelling skills.

- This position will represent Valorem's approach to data visualization and information delivery solutions and as such must demonstrate proficiency with Power BI and Azure Data Services.

Key Responsibilities :


- Design and implement general architecture for complex data systems

- Translate business requirements into functional and technical specifications

- Design and implement lakehouse architecture

- Develop and manage cloud-based data architecture and reporting solutions

- Apply data modelling principles for relational and dimensional data structures

- Design Data Warehouses following established principles (e.g., Kimball, Inmon)

- Create and manage source-to-target mappings for ETL/ELT processes

- Mentor junior engineers and contribute to architectural decisions and code reviews

Minimum Qualifications :


- Bachelors degree in computer science, Computer Engineering, MIS, or related field

- 5+years of experience with Microsoft SQL Server and strong proficiency in T- SQL, SQL performance tuning (Indexing, Structure, Query Optimization)

- 5+years of experience in Microsoft data platform development and implementation

- 5+years of experience with PowerBI or other competitive technologies

- 3+years of experience in consulting, with a focus on analytics and data solutions

years of experience with Databricks, including Unity Catalog, Databricks SQL, Workflows, and Delta Sharing

- Proficiency in Python and Apache Spark

- Develop and manage Databricks notebooks for data transformation, exploration, and model deployment

- Expertise in Microsoft Azure services, including Azure SQL, Azure Data Factory (ADF), Azure Data Warehouse (Synapse Analytics), Azure Data Lake, and Stream Analytics

Preferred Qualifications :


- Experience with Microsoft Fabric

- Familiarity with CI/CD pipelines and infrastructure-as-code tools like Terraform or Azure Resource Manager (ARM)

- Knowledge of taxonomies, metadata management, and masterdata management

- Familiarity with data stewardship, ownership, and data quality management

Expertise in Big Data technologies and tools :

- BigData Platforms : HDFS, MapReduce, Pig, Hive

- General DBMS experience with Oracle, DB2, MySQL, etc

- No SQL databases such as HBase, Cassandra, DataStax, MongoDB, CouchDB, etc

- Experience with non-Microsoft reporting and BI tools, such as Qlik, Cognos, MicroStrategy, Tableau, etc

About Reply :


- Reply specializes in the design and implementation of solutions based on new communication channels and digital media.

- Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things.

- Reply services include Consulting, System Integration and Digital Services

  • Consultant II

    1 week ago


    Cochin, Kerala, India Reply Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    As a Data Analyst, you will play a critical role in bridging the gap between business needs and technical solutions. You will work closely with stakeholders to understand requirements, analyze data sources, and define transformation logic that supports strategic decision-making. The ideal candidate will have extensive experience with projects related to the...

  • Consultant II

    1 week ago


    Cochin, Kerala, India Reply Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Azure Cloud Engineer with strong DevOps and Cloud Foundation expertise. The role involves designing, implementing, and managing scalable, secure, and cost-efficient cloud solutions on Microsoft Azure. The ideal candidate will have a solid background in infrastructure as code (IaC), CI/CD automation, governance...

  • Consultant III

    1 week ago


    Cochin, Kerala, India Reply Full time ₹ 12,00,000 - ₹ 36,00,000 per year

     As a Data Governance Specialist, you will be instrumental in establishing and maintaining data governance frameworks that ensure data integrity, quality, and compliance across client organizations. You will collaborate with business and technical teams to define data standards, policies, and procedures that support strategic data initiatives. The ideal...

  • Reply - Data Analyst

    8 hours ago


    Cochin, Kerala, India VALOREM PVT LTD Full time

    Description : - As a Data Analyst, you will play a critical role in bridging the gap between business needs and technical solutions. - You will work closely with stakeholders to understand requirements, analyze data sources, and define transformation logic that supports strategic decision-making. - The ideal candidate will have extensive experience...


  • Cochin, Kerala, India Valorem Reply Full time US$ 1,20,000 - US$ 2,00,000 per year

    Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace. Through the expertise of their people and power of Microsoft technologies, they provide hyper-scale and agile delivery of unique digital business services, strategic...


  • Cochin, Kerala, India VALOREM PVT LTD Full time

    Description : Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace. Through the expertise of their people and power of Microsoft technologies, they provide hyper-scale and agile delivery of unique digital business...


  • Cochin, Kerala, India VALOREM PVT LTD Full time

    Description : As a Data Governance Specialist, you will be instrumental in establishing and maintaining data governance frameworks that ensure data integrity, quality, and compliance across client organizations. You will collaborate with business and technical teams to define data standards, policies, and procedures that support strategic data...


  • Cochin, Kerala, India VALOREM PVT LTD Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Description : Reply, we are hiring a Junior Backend Engineer. She/he will be a key member of the team building our next-generation Dedicated Automation Layer. This is a unique opportunity to grow skills by working on a complex, real-world microservices project. Under the mentorship of our senior engineers, she/he will contribute to developing, testing,...

  • Reply - Consultant II

    8 hours ago


    Cochin, Kerala, India VALOREM PVT LTD Full time

    Description : Reply, we are hiring a Full Stack Developer on the LEA Delivery Team, a key player in building and customizing our proprietary logistics applications. LEA is a powerful, Java-based framework, and a deep understanding of its architecture is essential for success. She/he will be responsible for developing and configuring both the...


  • Cochin, Kerala, India VALOREM PVT LTD Full time

    Description : Reply is an award-winning digital transformation firm focused on delivering data driven enterprise, IT modernization, customer experience, product transformation and digital workplace. Through the expertise of their people and power of Microsoft technologies, they provide hyper-scale and agile delivery of unique digital business...