Databricks Platform Architect
2 days ago
We are seeking a highly skilled Databricks Platform Architect to join our team at CirrusLabs in Bengaluru and Hyderabad. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing data pipelines and analytics solutions on the Databricks platform.
About the Role:
The ideal candidate will have extensive experience with Databricks, Big Data technologies, and data processing frameworks. You will work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
Key Responsibilities:
- Databricks Implementation: Design and implement scalable data solutions using Databricks, ensuring optimal performance and cost efficiency.
- Data Pipeline Development: Build and maintain robust ETL/ELT data pipelines to process large datasets from various sources, leveraging Databricks notebooks and Spark.
- Collaboration: Work closely with cross-functional teams to ensure seamless integration of data workflows and architecture.
- Big Data Technologies: Utilize various Big Data technologies and frameworks, including Apache Spark, Delta Lake, and others, to enhance data processing capabilities.
- Data Integration: Integrate data from multiple sources, ensuring data quality and consistency across the platform.
- Performance Optimization: Monitor and optimize the performance of data processing jobs, identifying and addressing bottlenecks and inefficiencies.
- Documentation: Create and maintain comprehensive documentation of data workflows, architecture, and best practices for the Databricks environment.
- Security and Compliance: Implement best practices for data security, privacy, and compliance within the Databricks platform.
Qualifications:
- Bachelor's or master's degree in computer science, Data Engineering, or a related field.
- 6+ years of experience in data engineering or data platform development, with a strong focus on Databricks.
- Proficiency in Apache Spark, with hands-on experience in Spark SQL and DataFrames.
- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their respective data services.
- Experience with data integration tools and technologies, such as Apache Kafka, Airflow, or similar.
Salary Range: ₹ 25 lakhs - ₹ 40 lakhs per annum.
Benefits: Comprehensive health insurance, flexible work arrangements, and opportunities for professional growth and development.
-
Expert Databricks Solutions Architect
2 weeks ago
Hyderabad, Telangana, India Recro Full timeDream Big: Become a Databricks Practice LeadWe Are Recro: A Trailblazing Company in Data EngineeringAre you ready to pioneer the future of data engineering innovation? We seek an exceptional leader to spearhead our Databricks practice, drive impactful customer engagements, and deliver cutting-edge solutions.About This RoleGrow & Thrive: Develop and expand...
-
Databricks Solutions Architect
2 days ago
Hyderabad, Telangana, India CirrusLabs Full timeWe are seeking a seasoned Databricks expert to spearhead data engineering initiatives at CirrusLabs. The successful candidate will possess in-depth knowledge of Big Data technologies and a proven track record in designing and implementing scalable data pipelines using Databricks.Job OverviewCirrusLabs is a pioneering firm that harnesses the power of...
-
Data Platform Architect
3 weeks ago
Hyderabad, Telangana, India Aptusdatalabs Technologies Pvt. Ltd Full timeAbout the RoleWe are seeking an experienced Data Platform Architect to lead the design, implementation, and maintenance of our Azure-based data platforms. As a key member of our team, you will be responsible for creating scalable and reliable data solutions that meet the needs of our organization.ResponsibilitiesDesign and implement Azure-based data...
-
Databricks Solutions Architect
3 weeks ago
Hyderabad, Telangana, India Wenger & Watson Inc. Full timeJob Description: We are seeking an experienced Data Engineer Leader to join our team at Wenger & Watson Inc. The successful candidate will have a strong background in data engineering, with expertise in designing and implementing large-scale data pipelines on the Databricks platform.Responsibilities:Develop and maintain ETL processes using Databricks...
-
Data Engineering Practice Lead
3 weeks ago
Hyderabad, Telangana, India Recro Full timeAt Recro, we are seeking a visionary Data Engineering Practice Lead to drive innovation and excellence in our Databricks practice.About the RoleThis is an exceptional opportunity for a seasoned data engineering leader to take ownership of our growing Databricks practice and set industry benchmarks. As the Practice Lead - Databricks Strategist, you will be...
-
Databricks Data Engineering Practice Lead
3 weeks ago
Hyderabad, Telangana, India Recro Full timeTransformative Leadership Opportunity in Databricks Data EngineeringWe are seeking a visionary and dynamic Databricks Data Engineering Practice Lead to drive innovation and growth in our data engineering practice. As a key member of our team, you will be responsible for building and growing our Databricks practice, delivering cutting-edge data solutions, and...
-
Hyderabad, Telangana, India Tata Consultancy Services Full timeAbout TCS">Tata Consultancy Services (TCS) is a global leader in consulting and information technology services, dedicated to helping clients succeed in the constantly changing world of business. With a rich legacy spanning over 50 years, TCS has earned an unparalleled reputation for delivering exceptional value to clients through its unmatched expertise in...
-
Data Engineering Practice Lead
4 weeks ago
Hyderabad, Telangana, India Recro Full timeData Engineering Practice Lead - Databricks We are seeking a visionary leader to drive innovation and growth in our Databricks practice. As the Data Engineering Practice Lead, you will be responsible for developing and expanding our Databricks capabilities, delivering cutting-edge data solutions, and driving impactful customer engagements.About the RoleThis...
-
Databricks Expert: AIonOS Data Engineering Lead
4 weeks ago
Hyderabad, Telangana, India AIonOS Full timeWe are seeking an experienced Databricks expert to lead our data engineering practice and drive business growth. As a key member of our team, you will be responsible for developing and implementing large-scale data processing solutions using Databricks technologies.Key Responsibilities:Lead the development of service offerings and methodologies tailored to...
-
Databricks Practice Lead
3 weeks ago
Hyderabad, Telangana, India Recro Full timeAbout the RoleWe are seeking a visionary leader to drive innovation in our Databricks practice, delivering cutting-edge data solutions and impactful customer engagements.As the Practice Lead - Databricks, you will:Lead & Grow: Develop and expand our Databricks practice, crafting methodologies, best practices, and service offerings tailored to client...
-
Senior Databricks Practice Manager
2 weeks ago
Hyderabad, Telangana, India Recro Full timeWe are seeking a highly skilled Senior Databricks Practice Manager to lead our team in delivering cutting-edge data solutions and driving impactful customer engagements.About the RoleThe ideal candidate will have 10+ years of experience in data engineering, with 3-5 years of hands-on experience in Databricks. They will be responsible for developing and...
-
Cloud Data Architect Leader
1 month ago
Hyderabad, Telangana, India HS Solutions Inc Full timeAbout HS Solutions Inc.We are a leading provider of data engineering services, and we are currently seeking an experienced Cloud Data Architect Leader to join our team.Salary: The estimated annual salary for this position is $250,000 - $350,000, depending on experience and qualifications.Job Description:As a Cloud Data Architect Leader at HS Solutions Inc.,...
-
Senior Data Architect
2 days ago
Hyderabad, Telangana, India Milestone Technologies, Inc. Full timeJob Title: Senior Data ArchitectWe are seeking an experienced Senior Data Architect to join our team at Milestone Technologies, Inc. as an ETL Lead. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables.About the Role:The successful candidate will...
-
Data Modeling Expert for Azure and Databricks
4 weeks ago
Hyderabad, Telangana, India Reveille Technologies Full timeJob Title: Data Modeling Expert for Azure and Databricks\About the Role:We are seeking a highly skilled Data Modeler to join our team at Reveille Technologies. This is an exciting opportunity to work on designing, implementing, and maintaining data models that support data quality, performance, and scalability.\Key Responsibilities:Designing and implementing...
-
Data Migration Architect
6 days ago
Hyderabad, Telangana, India Acunor Full timeCloud Data Engineer - Lead PositionAt Acunor, we are seeking a skilled Cloud Data Engineer to lead our data migration efforts from Teradata to Snowflake and Databricks on Azure Cloud. This key leadership role will drive the migration strategy, ensuring a seamless transition of data systems and pipelines to cloud-based platforms.As a Cloud Data Engineer at...
-
Databricks Practice Lead
2 weeks ago
Hyderabad, Telangana, India Recro Full timeTransformative Data Solutions LeaderWe are seeking a visionary leader to drive innovation and growth in our Databricks practice. As the Practice Lead, you will develop and expand our expertise in Databricks-based solutions, delivering cutting-edge data processing, analytics, and machine learning capabilities.About the RoleDevelop and grow our Databricks...
-
Databricks Practice Lead
1 month ago
Hyderabad, Telangana, India Recro Full timeAbout the RoleWe are seeking a dynamic and visionary Databricks Data Engineering Practice Lead to build and grow our Databricks practice, delivering cutting-edge data solutions and driving impactful customer engagements.Key Responsibilities:Develop and expand our Databricks practice, crafting methodologies and best practices tailored to client needs.Oversee...
-
Senior Data Hub Architect Lead
2 days ago
Hyderabad, Telangana, India ValueLabs Full timeWe are seeking a Senior Data Hub Architect Lead to join our team at ValueLabs. This is an exciting opportunity for experienced professionals who want to take their skills to the next level.Job DescriptionThe Senior Data Hub Architect Lead will be responsible for designing and implementing a low-latency data hub using Databricks, based on a pre-defined data...
-
Cloud Data Architect
4 weeks ago
Hyderabad, Telangana, India Milestone Technologies, Inc. Full timeMilestone Technologies, Inc. is seeking a highly skilled Cloud Data Architect to lead the development of our cloud-native data infrastructure.The estimated salary for this position is $120,000 - $180,000 per year, depending on experience and qualifications.About the RoleWe are looking for a Senior ETL Developer who can harness state-of-the-art data...
-
Data Engineering Practice Lead
4 weeks ago
Hyderabad, Telangana, India Recro Full timeWe are seeking a visionary Data Engineer to lead our Databricks practice and drive data engineering innovation.About the RoleAs a Data Engineering Practice Lead, you will be responsible for developing and expanding our Databricks practice, crafting methodologies, best practices, and service offerings tailored to client needs.You will oversee multiple...