Senior Databricks Engineer/Technical Lead/Data Architect
1 month ago
About Tredence :
Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering.
The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale.
Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.
We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data's full potential.
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / event-based data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail.
Mandatory Skills : Python/ PySpark / Spark with Azure/ AWS Databricks
Tredence is an equal opportunity employer.
We celebrate and support diversity and are committed to creating an inclusive environment for all employees.
-
Architect : Big Data / Ml
4 weeks ago
Delhi, India Databricks Full timeAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...
-
Solutions Architect
4 weeks ago
Delhi Cantonment, Delhi, Delhi, India Databricks Full timeAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...
-
Solutions Architect
1 week ago
new delhi, India Databricks Full timeAs a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...
-
Spendcube - Databricks Lead
2 weeks ago
Delhi, India Marlabs LLC Full timeDescription:Job Title: Technical Lead - Azure DatabricksLocation: Bangalore, IndiaPosition Overview:We are looking for an experienced Technical Lead with 8 to 10 years of hands-on experience working on Azure Databricks and Azure native services. The Technical Lead will play a critical role in managing and driving day-to-day data engineering work and leads...
-
SIOP - Databricks Architect
2 weeks ago
Delhi, India Marlabs LLC Full timeDescription:Job Title: Data Architect - Azure DatabricksLocation: Bangalore, IndiaPosition Overview:We are looking for a Data Architect with 10 to 12 years of experience specializing in Azure Databricks and Azure native services. The ideal candidate will have a proven track record of designing and implementing scalable, high-performance data solutions in...
-
Technical Architect
3 days ago
delhi, India Allianz Services Full timeDesignation - Senior Manager / Technical Architect – Data EngineeringExperience Range – 10 to 16 YearsEducation - Bachelor's/master’s degree in computer science, Data Science, or a related fieldLocation – Trivandrum or PuneRoles & responsibility -• Architecting, designing, and implementing scalable data solutions in the data engineering space•...
-
Databricks Architect/Developer
4 weeks ago
Delhi, India Exusia Full timeAbout The PositionDepartment:Sales and Delivery Team - EmpowerIndustry:Information Technology & Services, Computer Software, Management ConsultingLocation:BangaloreExperience Range: 5+ yearsBasic Qualification:Master/Bachelor of Engineering or EquivalentTravel Requirements:Not requiredWebsite:Exusia, a cutting-edge digital transformation consultancy, seeks...
-
Data Engineer
1 month ago
delhi, India VSquare Systems Pvt. Ltd. Full timeJob Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...
-
Data Engineer
1 week ago
delhi, India The Ksquare Group Full timeRequirementsBachelor's degree in computer science, information technology, or a related field.Prior experience with data lakes and data warehouses, working knowledge with dimensional modeling is must.Demonstrate advanced understanding in data engineering practices, Including ETL/ELT, data integrations, reusable data pipelines,data management methods.Advanced...
-
Senior Architect- Azure Databricks
4 days ago
Delhi, India Tredence Full timeAbout TredenceTredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range...
-
FHN - Senior Databricks Developer
4 weeks ago
Delhi, India Marlabs LLC Full timeDescription:Job Title: Senior Data Engineer - Azure Databricks and Azure Native ServicesLocation: Bangalore,IndiaPosition Overview:We are looking for an experienced Senior Data Engineer with 6 to 8 years of hands-on experience working on Azure Databricks and its native services. The Senior Data Engineer will be responsible for designing, building, and...
-
Data Architect
3 weeks ago
Delhi, India Tredence Inc. Full timeCandidates from Bangalore/ Chennai/ Pune/ Gurgaon/ Pune/ Kolkata can applyRoles and Responsibilities:● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaboration with DW/BI leads to understanding new ETL pipeline...
-
delhi, India Streamline Full timeWho We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...
-
Senior Data Engineer
1 week ago
delhi, India V3 Staffing Solutions India P Limited Full timeWe have this opening with the global company that is shaping the future of gaming through groundbreaking technology and unparalleled creativity.Senior Data Engineer (AWS): Crafting Efficient Data Pipelines for Cloud PlatformsWe're seeking a seasoned Senior Data Engineer with over 9 years of hands-on experience in crafting and implementing highly efficient...
-
Enterprise Data Architect
4 weeks ago
Delhi, India Tech Mahindra Full timeRole: Enterprise Data ArchitectLocation: Pune, BangaloreExperience: 15+ yearsNotice period: Immediate to 30 Days MaxInterested candidates can share their profiles to .Position OverviewThe ideal candidate will have a strong background in designing, implementing, and maintaining data solutions on the Azure platform. You will collaborate closely with...
-
Data Solution Designer
2 weeks ago
Delhi, India XPT Software Australia Pty Ltd Full timeJob DescriptionWe are seeking a talented 10+ years Solution Designer with experience in Databricks to join our team. The ideal candidate will have a strong background in designing and implementing data solutions using Databricks platform. This role requires a deep understanding of data engineering principles, and cloud-based analytics. As a Solution...
-
Delhi, India Streamline Full timeWho We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...
-
Data Architect
4 weeks ago
delhi, India Nisum Full timeRequired above 10 years of ETL and Data Engineering experience.• Experience in solutions architect or senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)• Experience in modern data ingestion processes (datalake, datawarehouse, lakehouse)• Experience in data governance models• Experience with relational...
-
Delhi, India Streamline Full timeWho We AreAt Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help organizations navigate the constantly evolving landscape of IT. Our sole focus is ensuring that our client’s organization is armed with the strategies, products and solutions that are transformative to their business. Streamline works closely...
-
Lead Data Engineer
3 weeks ago
delhi, India Recro Full timePosition: Data Engineer(Lead)Location: WFO-BangaloreExperience Level: 8+ yearsJob Description:Summary:We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate...