Senior Data Engineer

3 weeks ago

Hubli, India EXL Full time

Key Responsibilities: • Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO. • Leverage technologies and solutions to innovate with increasingly large data sets. • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration. • Understand, implement and enforce Software development standards and engineering principles in the Big Data space. • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency. • Perform assigned tasks and production incident independently. Must Have: • 5-9 years of experience in Data Warehouse/Data Lake/Lake House related projects in product or service-based organization • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data. • Solid Experience of building complex data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge. • Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews • Write and maintain Unix shell scripts, Oracle SQL, PL/SQL, and perform SQL tuning. • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance • Use Git-based version control systems and CI/CD pipelines (e.g., Jenkins). • Implement and manage HIVE external tables, partitions, and various file formats. • Work across on-premises and cloud environments (AWS, Azure, Databricks). • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP). Experience of building Nifi pipelines.Preferred • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan • Strong communication skills - both verbal and written. • Ability to multi-task across multiple projects, interface with external / internal resources. • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement • Experience working diverse and geographically distributed project teams. Skills & Qualifications: Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

  • Senior Data Engineer

    3 weeks ago

    Hubli, India Spocto X (A Yubi Company) Full time

    About YubiYubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfillment, and collection of any debt solution. At Yubi, opportunities are plenty and we equip you with tools to seize it.In March...

  • Senior Data Engineer

    4 weeks ago

    Hubli, India Whatjobs IN C2 Full time

    Job Summary Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate...

  • Data Engineer

    4 weeks ago

    Hubli, India Sapphire Software Solutions Inc Full time

    HI FolksPlease check the JD and share your updated resume to my email naresh@sapphiresoftwaresolutions.com and ping me on whatsapp (+91 970-529-6474) along with your resumeData Engineer100% Remote1 year contractJOB DESCRIPTIONA global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is...

  • Data Engineer

    3 weeks ago

    Hubli, India Whatjobs IN C2 Full time

    Job Title: Data Engineer Location: Hyderabad / Chennai (Hybrid) Experience: 6–10 Years (STRICTLY) Employment Type: Permanent Notice Period: Immediate Joiners Only (≤15 days) Skills Required: Python, PySpark, AWS / Snowflake About the Company Our client is a global leader in IT and business services, operating in 50+ countries . They specialize in cloud,...

  • Senior AI

    4 weeks ago

    Hubli, India engineersmind Full time

    Role: Senior AI & Automation EngineerLocation: Bengaluru (Hybrid)Experience:5+yearsDepartment: Quality Engineering & Product AssuranceCompany: EngineersmindAbout the RoleWe’re seeking a highly driven Senior Software Test Engineer who takes complete ownership of product quality—from concept to customer delivery. You’ll be responsible for end-to-end...

  • Senior AI

    4 weeks ago

    Hubli, India engineersmind Full time

    Role: Senior AI & Automation EngineerLocation: Bengaluru (Hybrid)Experience:5+yearsDepartment: Quality Engineering & Product AssuranceCompany: EngineersmindAbout the RoleWe’re seeking a highly driven Senior Software Test Engineer who takes complete ownership of product quality—from concept to customer delivery. You’ll be responsible for end-to-end...

  • Data Engineer

    4 weeks ago

    Hubli, India People Prime Worldwide Full time

    About Company:-A leading global information technology, consulting, and business process services organization, the company delivers innovative solutions that enable clients across industries to thrive in the digital era. With a strong focus on technology-driven transformation, it helps enterprises harness the power of cloud, AI, automation, and analytics to...

  • Senior Data Scientist

    1 week ago

    Hubli, India AtkinsRéalis Full time

    About the Role: We are looking for a highly skilled Senior Data Scientist with deep hands-on expertise in machine learning, computer vision, generative AI, and cloud-based AI solutions (preferably Azure). The ideal candidate will drive innovation across our AI/ML initiatives and work closely with cross-functional teams to design, develop, and scale...

  • Senior Data Scientist

    2 weeks ago

    Hubli, India Related Account Propertyfinder FZ LLC Full time

    DUBAI BASED ROLE. Relocation would be required but with highly competitive, tax free salary package. Company Profile: - Property Finder is the leading digital real estate platform in the Middle East and North Africa region. - A UAE-born startup, Property Finder expanded its operations to Qatar, Bahrain, Saudi Arabia, Egypt and Turkey over the years - The...

  • Data Engineer

    4 weeks ago

    Hubli, India Deloitte Full time

    Your potential, unleashed.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations shaping the future of the region, and indeed, the world beyond.At Deloitte, your whole self to work, every day. Combine that with our...