Big Data

17 hours ago

Dharwad, India Diverse Lynx Full time

Hiring for Big Data PySpark Engineer - Chennai Bangalore Job Overview We are looking for a Big Data PySpark Engineer to join our dynamic data engineering team The ideal candidate will have hands-on experience with big data frameworks particularly Apache Spark with a focus on PySpark and be capable of building optimizing and managing large-scale data processing systems As a Big Data Engineer you will work closely with Data Scientists Analysts and Architects to design and implement efficient data pipelines and ensure that our data infrastructure is scalable and robust Responsibilities Data Pipeline Development Design develop and maintain scalable and efficient data pipelines using PySpark and related big data technologies Data Processing Transformation Write complex data transformations using PySpark to process large datasets and extract meaningful insights Optimization Performance Tuning Optimize Spark jobs for performance manage memory and data partitioning and troubleshoot performance bottlenecks ETL Workflows Build and manage ETL Extract Transform Load workflows that process data from various sources e g databases APIs file systems Data Integration Work with different data sources like HDFS AWS S3 Google Cloud Storage and relational or NoSQL databases Data Quality Monitoring Implement data validation checks and monitor data pipeline health logging and error handling Collaboration Collaborate with data scientists analysts and business teams to ensure data infrastructure meets the company s needs Cloud Computing Work with cloud platforms such as AWS Azure or GCP to deploy and manage big data workflows Documentation Best Practices Maintain clear documentation for code processes and system designs Promote best practices in coding version control and testing

  • Data Architect

    4 weeks ago

    Dharwad, India Dautom Full time

    Data Architecture Design & Strategy: Lead engagements with the internal stakeholders to understand their data needs and design solutions ensuring data quality and governance. Design the right pipeline architecture to handle data and support various use cases, including analytical reporting and machine learning. Design and evolve scalable and modular...

  • Delivery Lead- BFSI

    3 weeks ago

    Dharwad, India Tredence Inc. Full time

    About the Company Tredence is a global analytics services and solutions company. Our capabilities range from Advanced analytics and Data Management to Data Visualization, Big Data, Machine Learning & Gen AI. Our uniqueness is in bringing the right mix of technology and business analytics to create sustainable white-box solutions that are transitioned to our...

  • SDE-II Data Platform

    1 week ago

    Hubballi-Dharwad, India Navi Full time

    About the Team The Data Platform Tech Team at Navi is instrumental in enabling data-driven decision-making across the organization. We build and manage the core infrastructure and tools required to collect, store, process, and analyze data at scale. Our platforms support self-serve capabilities for both batch and real-time data processing. We work closely...

  • Strategy Analyst- Founder office

    5 days ago

    Dharwad, India MoveInSync Full time

    About MoveInSync MoveInSync is the world’s largest employee commute platform, serving over 430+ enterprise clients, including 104 Fortune 500 companies. Founded in 2009 and headquartered in Bangalore, MoveInSync optimises daily corporate commutes through innovative, safe, and sustainable mobility solutions across its product suite, MoveInSync ION and...

  • Machine Learning Researcher | Bangalore, India

    3 weeks ago

    Hubballi-Dharwad, India AAA Global Full time

    Location: Bangalore, IndiaDomain Focus: AI-Driven Algorithmic Trading, Deep Learning for Time Series AnalysisExperience: 3+ years of experience in ML research for financeInternational Talent: Yes, international applicants are encouragedThese roles are for technologists at heart, ML researchers eager to harness technology to transform traditional...

  • Sr Software Enginneer

    3 weeks ago

    Dharwad, India Varite Full time

    Company Name VARITE India Private Limited About The Client The Client is an American-owned company based in the US with offices in India and the Philippines A tech-forward outsourcing company specializing in supporting the US mortgage insurance and banking industries Essential Job Functions Design develop and test secure integration solutions leveraging...

  • Executive 2 - Health Insurance Claims

    4 weeks ago

    Dharwad, India Navi Full time

    About the Team The Claims team at Navi is responsible for delivering a fast, transparent, and customer-first claims experience. From initial intimation to final settlement-whether cashless or reimbursement-they manage the end-to-end process with a strong focus on accuracy and turnaround time. The team works closely with the Hospital Partnerships team to...

  • Associate Finance Manager

    4 weeks ago

    Dharwad, India Onsurity Full time

    Onsurity is a rapidly growing employee healthcare benefits platform that provides flexible and customised healthcare subscriptions for SMEs, start-ups, and enterprises. We believe that access to healthcare benefits shouldn't be a luxury. It is this philosophy that has strengthened our commitment towards making healthcare affordable and accessible for all....

  • KYC / AML Due Diligence

    1 week ago

    Hubballi-Dharwad, India AKM Global Full time

    As aKYC/AML Due Diligence Specialist,you will be a key member of our White Collar crime defense team, advising clients—including leading global financial institutions—on building and managing robust anti-money laundering (AML) and counter-terrorist financing (CFT) programs. Your work will involve conducting in-depth due diligence, investigating...