Data Engineer

3 weeks ago

Hubli, India Dautom Full time

Job Description: Data Engineer (Big Data/Kafka) We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.Key Details:Role: Data EngineerIndustry: Banking (Financial Services)Work Location: Remote (India)Contract Duration: 6 months initial contract (with a strong likelihood of extension to long-term)Notice Period: 30 days or lessNote: This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.Key Responsibilities:Technical Execution: Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.Team Leadership & Management: Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.Big Data Ecosystem Management: Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).Data Modeling & BI: Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.Data Integrity & Deployment: Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.Stream Processing: Develop and maintain solutions using stream-processing systems like Spark-Streaming.SQL & Performance Tuning: Demonstrate proficiency in writing and performance-tuning advanced SQL queries.Required Skills & Qualifications:Experience: 6-10+ years of proven experience as a Big Data Engineer.Big Data Frameworks: In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.Programming & Scripting: Strong expertise in Java. Experience with object-oriented/object function scripting languages like Python and Scala.Querying Tools: Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.Databases: Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).Streaming Tech: Hands-on experience with stream-processing systems like Spark-Streaming or Storm.Data Modeling: Proven experience in designing and building dimensional data models.Leadership: Demonstrated experience leading a Backend/Distributed Data Systems team while remaining technically hands-on.Preferred Skills (Pluses):Experience with Azure cloud services.Knowledge of data science and machine learning tools and technologies.Experience in the Financial Services/Banking industry.Personal Attributes:Able to effectively plan, organize, and own deliverables.Strong interpersonal and communication skills.Ability to solve complex networking, data, and software issues.A collaborative team player who builds and maintains cooperative work relationships.

  • Data engineer

    4 weeks ago

    Hubli, India Vriba Solutions Full time

    Role: Data Engineering Remote Looking for 5-10 years of Exp• Design, develop & maintain ETL/ELT pipelines• Ingest & transform data from APIs, DBs, files, streams• Build real-time & batch processing solutions• Data validation, quality & cleansing• Translate business needs into data models• Ensure data security, access control & compliance•...

  • Data Engineer

    3 weeks ago

    Hubli, India AS Technology Corporation Full time

    We are seeking skilled and motivated Spark & Databricks Developers to join our dynamic team for a long-term project. The ideal candidate will have strong hands-on experience in Apache Spark, Databricks, and GitHub-based development workflows.Key Responsibilities:Design, develop, and optimize big data pipelines using Apache Spark.Build and maintain scalable...

  • Aws data engineer

    3 weeks ago

    Hubli, India Coforge Full time

    AWS Data EngineerJob Location: BengaluruExperience Required: 5+ YearsMandatory Skills: AWS Services, ETL, ETL Integration, Code Pipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, Cloud Watch, Prometheus, Grafana, Python, Shell, or Power ShellJob Description:We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience...

  • Data engineer ii

    2 days ago

    Hubli, India ClearDemand Full time

    Job Summary: Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our data collection and analytics platform, capable of handling terabyte-scale data and billions of data points. Key Responsibilities Lead the design,...

  • Data Scientist

    3 weeks ago

    Hubli, India Whatjobs IN C2 Full time

    Job Summary: We are seeking a highly skilled and analytical Data Scientist with hands-on experience in designing, developing, and deploying data-driven solutions. The ideal candidate will have strong expertise in data analysis, machine learning, and cloud-based model deployment preferably on Google Cloud Platform (GCP). This role involves working closely...

  • Data Scientist

    1 week ago

    Hubli, India v4c.ai Full time

    Overview: The Data Scientist supports the development and implementation of data models, focusing on Machine Learning, under the supervision of more experienced scientists, contributing to the team’s innovative projects.Job Description:Assist in the development of Machine Learning models and algorithms, contributing to the design and implementation of...

  • Data consultant

    3 days ago

    Hubli, India Plative Full time

    The Data Consultant plays a key role in designing, implementing, and supporting data integration and analytics solutions across Salesforce, Net Suite, and other enterprise systems. This position focuses primarily (~80%) on Salesforce–Net Suite integration and data migration projects, ensuring seamless data flow across front-office and back-office...

  • Plm Teamcenter Data Engineer Siemens

    2 days ago

    Hubli, India Whatjobs IN C2 Full time

    Required Skills - Solid knowledge of Teamcenter OOTB utilities such as CSV2TCXML, TCXML_IMPORT, and TCIN_IMPORT, with the ability to explore and utilize configuration options effectively. - Proven expertise in troubleshooting and resolving errors during data loading processes, particularly in NX load scenarios (handling data migration and integration for NX...

  • L2/L3 Data Plane developer

    2 days ago

    Hubli, India ACL Digital Full time

    Hello Connections,ACL Digital is hiring for Data Plane Developer for Bangalore location.Job Title: Senior Software Engineer – C Programming (L2/L3 Dataplane Development)Experience Required: 5–7 Years Location: Bangalore Employment Type: Full-timeJob DescriptionWe are looking for a highly skilled Senior Software Engineer with strong expertise in C...

  • AI Engineer

    3 weeks ago

    Hubli, India Vivriti Capital Full time

    Job Title: Lead – AI EngineeringAbout Vivriti GroupVivriti Group is a trailblazer in the mid-market lending space, offering customized debt solutions to mid-sized enterprises. The group operates through two core businesses: Vivriti Capital Limited: A systematically important NBFC (ND-SI) regulated by the Reserve Bank of India (RBI). Vivriti Capital has...