Data Architect
2 days ago
Data Architect
Responsibilities:
Data Pipeline Development\: Design, build, and maintain robust and scalable data pipelines using Databricks and Apache Spark, primarily with Scala, to ingest, process, and transform large datasets from various sources.
ETL/ELT Implementation\: Develop and optimize Extract, Transform, Load ETL or Extract, Load, Transform ELT processes within the Databricks environment to ensure data quality, consistency, and availability for analytical purposes.
Experience on Snowflake
API Development\: Design, develop, and deploy secure and efficient RESTful APIs using AWS services like Lambda and API Gateway to expose data or trigger data processing workflows.
Cloud Infrastructure Management\: Utilize AWS services for data storage, compute, and other infrastructure components related to data engineering solutions.
Performance Optimization\: Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
Data Governance and Security\: Implement data governance best practices, ensuring data security and compliance within the Databricks and AWS environments, including securing API endpoints.
Collaboration\: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.
Monitoring and Troubleshooting\: Monitor data pipelines, identify and resolve issues, and ensure the reliability and availability of data systems.
Qualifications:
Proficiency in Scala\: Strong programming skills in Scala, specifically in the context of Apache Spark.
Databricks Expertise\: In-depth experience with Databricks platform, including Databricks notebooks, Delta Lake, and cluster management.
Apache Spark Mastery\: Extensive experience with Apache Spark for big data processing, including Spark SQL, Spark Streaming, and Spark MLlib.
AWS Cloud Experience\: Hands-on experience with AWS services, particularly Lambda, API Gateway, S3, EC2, and potentially other relevant services like Glue or Redshift.
API Development\: Proven ability to design and implement secure RESTful APIs, including authentication and authorization mechanisms.
Data Warehousing Concepts\: Understanding of data warehousing principles, data modeling, and schema design.
SQL Proficiency\: Strong SQL skills for data manipulation and analysis.
Problem-Solving\: Excellent analytical and problem-solving skills with a focus on delivering high-quality data solutions.
Communication\: Effective communication skills to collaborate with technical and non-technical stakeholders.
-
Salesforce Revenue Cloud Architect
6 days ago
Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearReq ID: 346275NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Revenue Cloud Architect to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Summary The...
-
Data Architect
6 hours ago
Chennai, Tamil Nadu, India OneMagnify Full time ₹ 12,00,000 - ₹ 24,00,000 per yearThe Data Architect is responsible for designing and managing robust, scalable data solutions that ensure data accuracy, accessibility, and security to support both internal and client-facing needs. As part of the Data Platform team, this role collaborates closely with Solution Architects to align data architecture with broader application design, and...
-
Data Architect
1 week ago
Chennai, Tamil Nadu, India Montra Electric Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the Role:We are seeking a seasoned Data Engineering Architect with 15+ years of experience designing and scaling enterprise-grade data platforms to lead the architecture of our Connected Electric Vehicle (EV) Platform.This role requires deep expertise in cloud-native (AWS & GCP) data ecosystems, real-time streaming infrastructure, and architecting...
-
Data Architect
4 days ago
Chennai, Tamil Nadu, India Pando Full time ₹ 12,00,000 - ₹ 36,00,000 per yearData ArchitectPando ) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, & unified platform empowering Autonomous Supply...
-
Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year• Architect and implement scalable Azure Databricks solutions, including Data Lakehouse, Delta Lake, Structured Streaming, Unity Catalog, and Medallion Architecture.• Design and manage advanced ETL/ELT pipelines utilizing PySpark, Databricks Workflows, Data Factory, and Azure Storage services.• Lead ML engineering and MLOps implementation, leveraging...
-
AWS Data Architect
1 week ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAWS Data Architect Role\: T0The ideal professional for this AWS Architect role will:● Have a passion for design, technology, analysis, collaboration, agility, and planning, along with a drive for continuous improvement and innovation.● Exhibit expertise in managing high-volume data projects that leverage Cloud Platforms, Data Warehouse reporting and BI...
-
Data Modeler
1 week ago
Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 3,60,00,000 - ₹ 9,36,00,000 per yearKey ResponsibilitiesDesign Models: Create robust conceptual, logical, and physical data models for critical banking systems.Ensure Compliance: Apply deep banking domain knowledge to ensure models meet regulatory and business needs.Optimize Performance: Tune models to ensure high-speed performance on target platforms (e.g., Snowflake, Oracle).Set Standards:...
-
Data Architect – Data Migration
2 weeks ago
Chennai, Tamil Nadu, India Biztechnosys Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Data Architect – Data Migration & Compliance Platform Modernization Location: Lakshimi Colony, T. Nagar, Chennai (This is work from office for 3 months initially Duration: Long-term (C2H)Role Summary: We are seeking a highly experienced and hands-on Data Architect to lead and deliver the end-to-end data migration from Databricks and Teradata to...
-
Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Isoftronics Full time ₹ 12,00,000 - ₹ 36,00,000 per yearCompany OverviewIsoftronics is a dynamic IT service provider based in Chennai, specializing in delivering cutting-edge technology solutions and consulting services to help businesses achieve their objectives. With a focus on efficient operations, we provide strategic IT consulting for a range of infrastructures. Our team consists of 11-50 dedicated employees...
-
Senior Data Architect
2 weeks ago
Chennai, Tamil Nadu, India Mphasis Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description: -Experience YearsLocation - Chennai, IndiaWho are we looking for?As a Senior Data Architect in the BFSI domain, you will be responsible for designing and governing data architecture across core banking, Wealth Management and financial platforms. You'll lead initiatives that span legacy systems (mainframes) to modern cloud-native and NoSQL...