Data Engineer

7 days ago

Nadiad, India Dautom Full time

Job Description: Data Engineer (Big Data/Kafka) We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector. Key Details: - Role: Data Engineer - Industry: Banking (Financial Services) - Work Location: Remote (India) - Contract Duration: 6 months initial contract (with a strong likelihood of extension to long-term) - Notice Period: 30 days or less - Note: This role is for professionals seeking a contract engagement, not for freelancers or independent contractors. Key Responsibilities: - Technical Execution: Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark. - Team Leadership & Management: Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture. - Big Data Ecosystem Management: Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra). - Data Modeling & BI: Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices. - Data Integrity & Deployment: Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy. - Stream Processing: Develop and maintain solutions using stream-processing systems like Spark-Streaming. - SQL & Performance Tuning: Demonstrate proficiency in writing and performance-tuning advanced SQL queries. Required Skills & Qualifications: - Experience: 6-10+ years of proven experience as a Big Data Engineer. - Big Data Frameworks: In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks. - Programming & Scripting: Strong expertise in Java. Experience with object-oriented/object function scripting languages like Python and Scala. - Querying Tools: Good knowledge of Big Data querying tools such as Pig, Hive, and Impala. - Databases: Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra). - Streaming Tech: Hands-on experience with stream-processing systems like Spark-Streaming or Storm. - Data Modeling: Proven experience in designing and building dimensional data models. - Leadership: Demonstrated experience leading a Backend/Distributed Data Systems team while remaining technically hands-on. Preferred Skills (Pluses): - Experience with Azure cloud services. - Knowledge of data science and machine learning tools and technologies. - Experience in the Financial Services/Banking industry. Personal Attributes: - Able to effectively plan, organize, and own deliverables. - Strong interpersonal and communication skills. - Ability to solve complex networking, data, and software issues. - A collaborative team player who builds and maintains cooperative work relationships.

  • Data engineer

    6 days ago

    Nadiad, India NuVision Auto Glass Full time

    Nu Vision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield replacement and expert auto glass services, ensuring convenience and safety at every step.With seamless insurance claims, easy financing options for cash payments,...

  • Senior Data Engineer

    3 weeks ago

    Nadiad, India Net Zero Insights Full time

    Senior Data EngineerAbout Net Zero InsightsNet Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide. Our cutting-edge Net0 Platform provides access to thousands of startups/SMEs, deals, investors, market reports, and more,...

  • Data engineer

    5 days ago

    Nadiad, India Delta Air Lines Full time

    About Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U. S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Data Scientist

    2 weeks ago

    Nadiad, India Enterprise Minds, Inc Full time

    Job Description: Data Scientist (8+ Years)Location: RemoteNotice Period: Immediate to 15 DaysExperience: 8+ YearsRole SummaryWe are seeking a highly experienced Data Scientist / Data Science Engineer to design, build, deploy, and maintain machine learning models and scalable production systems. This role focuses on bridging the gap between research and...

  • Big data developer

    5 days ago

    Nadiad, India BayOne Solutions Full time

    Job Description:We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering,...

  • Data architect

    5 days ago

    Nadiad, India Persistent Systems Full time

    About Position: We are seeking a highly skilled and experienced Azure Databricks Architect to lead the design, development, and implementation of scalable data solutions using Azure Databricks. This role involves working closely with cross-functional teams to architect data pipelines, optimize performance, and ensure secure and efficient data processing...

  • It data integration engineer

    5 days ago

    Nadiad, India Classified Jobs Full time

    Key Responsibilities:Design and develop integration solutions using Azure services such as Azure Data Factory, Azure Logic Apps, Azure Functions for building scalable integration workflowsDevelop and manage APIs through Azure API Management to facilitate seamless integration between various systems.Implement best practices for Enterprise Application...

  • Data Scientist

    7 days ago

    Nadiad, India Lingaro Full time

    Role: Data Scientist - Gen AILocation: India, RemoteAbout Lingaro:Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.Since 2008, Lingaro has been recognized by...

  • SAP Data Architect

    4 weeks ago

    Nadiad, India RED Global Full time

    Title: SAP Data Architect ConsultantLocation: remote IndiaIndustry: Pharmaceutical Type: 12 month initial contract with extensions Rate: 23/hr USDDescription:We have a current opportunity for a SAP Data Architect on a contract basis. The position will be based in India.You must have your own Laptop or PC in order to perform the dutiesFor further...

  • Data Analyst

    3 weeks ago

    Nadiad, India V2Soft Full time

    The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users.Must-Have Qualifications 5+ years of experience in data analysts, data engineering, or other data related rolesHan ds-on experience...