Architect Big Data Scala

5 days ago

sany, India Findernest Software Services Pvt Ltd Full time
Qualifications
  • Bachelorsdegree in Computer Science or Computer Engineering from anaccredited university
  • 10 years of relevantindustry experience after completingeducation
  • 5 years of Scala and Java applicationdesign and testing experience in theindustry
  • Strong working knowledge of FunctionalProgramming paradigm and category theory in languages like Scala orHaskell
  • Working experience with realtimeStreaming and batch processing with Apache Spark and Apache Flink(Experience on one platform is alsofine)
  • Strong knowledge of distributed filesystems memory management sharding and partitioning datasets/dataframes
  • Strong fundamentals in functionalprogramming Objectoriented programming RESTful architectures DesignPatterns Data Structures andalgorithms
  • Experience with MicroservicesInfrastructure management for Development; working on DockerKubernetes Helm/Terraform
  • Experience withMicrosoft Azure and cloud services including exposure to PaaSservices like service bus event hubs blob stores key vaults APImanagers Function Apps (serverless) and AzureDatabricks
  • Expertise in Scala is mandatory andJava is optional.
  • Microservices implementationskills will be a plus
  • Experience OAuth 2.0(JWT) Swagger Postman Open APISpecification
  • Relational (SQL Server /Postgres); NoSQL (HBase) Delta Tables (Parquet and Avroformats)
  • Big Data/Geospatial (HBase 2.1.6 (HDI4.0 Geo mesa 3.0.0)
  • Caching (Redis playcaffeine or others)
  • Experience working withcloud platforms services like Azure or AWS
  • Goodworking knowledge of CI/CD environments (preferably Azure DevOps)Git or similar configuration management software; Build Automation(Maven)
  • Knowledge of Testing Tools such asScalaTest Junit andMockito
Responsibilities
  • Thedigital platform will enable products that integrate with connectedCNH Industrial tractors sprayers and combines and enable a widerange of farm management capabilities
  • Leading asmall team of software engineers and data engineers and alsocontributing individually to design develop and test data pipelinesfor data parsing enrichment andprocessing
  • Generate rapid prototypes forfeasibility testing
  • Contribute to growing teammembers building a strong cohesive team; and providing guidancementorship
  • Help and guide the team in theirdaytoday tasks

testing tools,sqlserver,apache spark,ci,scalatest,categorytheory,scala,cloud,algorithms,restful architectures,microsoftazure,oauth 2.0,postgres,nosql,big data,cd production,designpatterns,cloud services,git,swagger,relationaldatabases,object-oriented programming,partitioning,paasservices,docker,kubernetes,distributed file systems,datacaching,apache,terraform,maven,big data/geospatial (hbase,geomesa),caching,nosql (hbase),build automation (maven),cloudplatforms,redis,testing tools (scalatest, junit, mockito),azuredevops,delta tables (parquet and avro formats),caching (redis,play, caffeine),mockito,caffeine,junit,helm,memorymanagement,parquet,ci/cd environments,relational (sqlserver/postgres),play,geospatial,build automation,microservicesimplementation,postman,sharding,aws,delta tables,restfularchitecture,microservices infrastructure management,avroformats,hbase,functional programming,api,java,apache flink,objectoriented modeling,open api specification,datastructures,testing

  • Big Data Engineer

    4 weeks ago

    Sany, India TalentPulse Consultant Full time

    JobDescription:We are currentlyseeking a highly skilled Big Data Engineer to join our team on aremote basis. The ideal candidate will have at least 5 years ofexperience in Big Data technologies and a strong proficiency inPython Spark and Scala. This is an active position with a highpriority offering a competitive rate and the opportunity for alongterm...

  • Data Engineering Spark Scala with Java knowledgeIntermediate

    2 weeks ago

    Sany, India Horigine Consulting Pvt. Ltd Full time

    Mandatory Skills:Tech: Apache Spark PySparkProgramming Languages: JavaPythonCloud Platform: GCP Professionals with Specific skills required:- Experience in Spark and Distributed computing frameworks.- Professional hands-on experience in Scala/Python.- Professional hands-on experience in SQL and Query Optimization.- Experience in programming design patterns.-...

  • Data Architect

    4 weeks ago

    sany, India ConnectPro Consultant Full time

    Job PostingTitle Data Architect with 1014 yearsof Experience JobDescription Summary 1. Contribute tobusiness management by effectively solving businessrelated problemsthrough data modeling/analysis/management.2.Establish/support infrastructure that continuously grows tostrategically analyze big data. Job Description 1.Solving businessrelated...

  • Data Architect

    2 weeks ago

    Sany, India ConnectPro Consultant Full time

    Job PostingTitle Data Architect with 1014 yearsof Experience JobDescription Summary 1. Contribute tobusiness management by effectively solving businessrelated problemsthrough data modeling/analysis/management. 2.Establish/support infrastructure that continuously grows tostrategically analyze big data. Job Description 1.Solving businessrelated problems...

  • Software Development Engineer 2SD 2 Big DataEngineer

    4 weeks ago

    Sany, India Relic Consultancy Services Full time

    Responsibilities:Experience: 36 yrsGood developmentpracticesHands on coder with good experiencein programming languages like Java Python orScala.Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch.Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code...

  • Software Development Engineer 2SD 2 Big DataEngineer

    2 weeks ago

    Sany, India Relic Consultancy Services Full time

    Responsibilities:Experience: 36 yrsGood developmentpracticesHands on coder with good experiencein programming languages like Java Python orScala.Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch.Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code...

  • Data Architect

    7 days ago

    Sany, India Weekday Full time

    (This is a role for one of Weekdaysclients)MandatorySkills: Python/ PySpark / Spark with Azure/ AzureDatabricks / AzureDataFactoryPrimaryRoles and Responsibilities:Developing Modern Data Warehouse solutions usingDatabricks and AWS/ AzureStack Ability to provide solutions that areforwardthinking in data engineering and analyticsspace Collaborate with DW/BI...

  • Data Architect

    2 weeks ago

    sany, India Thought storm Full time

    Role: Data ArchitectLocation:Remote Visa Any on W2 No H1B No OPT Salary $160k/annum with benefitsDuration: FullTime/ Permanent Role Data architect with Hadoopis must haveJob Details: Experience handling Peta bytes of data inHadoopStrong experience in Code migration engagementslike Data stage to PySparkBuild Frameworks fortransformation/Code...

  • Data Architect

    1 week ago

    sany, India Thought storm Full time

    Role: Data ArchitectLocation:Remote Visa Any on W2 No H1B No OPT Salary $160k/annum with benefitsDuration: FullTime/ Permanent Role Data architect with Hadoopis must haveJob Details: Experience handling Peta bytes of data inHadoopStrong experience in Code migration engagementslike Data stage to PySparkBuild Frameworks fortransformation/Code...

  • Data Architect

    7 days ago

    Sany, India Thought storm Full time

    Role: Data Architect Location:Remote Visa Any on W2 No H1B No OPTSalary $160k/annum with benefits Duration: FullTime/ Permanent Role Data architect with Hadoopis must have Job Details: Experience handling Peta bytes of data inHadoop Strong experience in Code migration engagementslike Data stage to PySpark Build Frameworks fortransformation/Code quality...

  • Data Engineer

    4 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • Data Architect

    2 weeks ago

    Sany, India Spotlight Career Solutions Full time

    Hi Greetings of the Day A reputed Logisticscompany is hiring for the role of DataArchitect. Working days 5 Days of working (Work FromOffice) LocationBangalore Payroll DirectPayroll (On roll Pay) Roles &ResponsibilitiesExperience in BigqueryKafka Airflow Redshift. Working with data visualization tools (Tableau Power BILookerAlteryx etc.). Proven...

  • Azure Databricks Admin and Developer

    3 days ago

    Sany, India IndiSquad Full time

    JobDescription:One ofour client is seeking a talented and experienced Azure DatabricksAdmin and Developertojoin our team inYadwada Pune. The ideal candidate will have extensive experience inadministeringanddevelopingsolutions using Azure Databricks along with a strong understandingof cloud technologiesanddata...

  • Data Engineering Spark Scala with Java knowledgeIntermediate

    7 days ago

    sany, India Horigine Consulting Pvt. Ltd Full time

    Description: MandatorySkills: Tech: Apache Spark PySpark Programming Languages: JavaPython CloudPlatform : GCP 69 Years with Specific skills required:Skills:Experience in Spark and Distributedcomputing frameworks.Professional handon experience inscala/python.Professional handon experience in Sql andQuery Optimization.Experience in programming...

  • Azure Databricks Admin and Developer

    2 weeks ago

    sany, India IndiSquad Full time

    JobDescription:One ofour client is seeking a talented and experienced Azure DatabricksAdmin and Developertojoin our team inYadwada Pune. The ideal candidate will have extensive experience inadministeringanddevelopingsolutions using Azure Databricks along with a strong understandingof cloud technologiesanddata...

  • AWS Data Architect

    4 weeks ago

    Sany, India TalentOla Full time

    Role: AWS Data ArchitectExperience and skills: Havedone extensive work in working with various types of databases suchas MySQL mssql nosql db variants Have workingknowledge on AWS data services Glue Athena Lakeformation Databasemigration services AppFlow SQSSNS Notebook EventbridgeDatasync Have worked with Hadoop clusters.Specific knowledge of AWS...

  • Data Engineer

    2 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer Azure

    5 days ago

    Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...

  • Senior Data Architect

    4 weeks ago

    Sany, India Geminisolutions Full time

    Senior Data ArchitectIf you have a passion for all things data aninquisitive mind to learn an eye for detail a commitment to thehighest quality of work and a desire to take on additionalresponsibilities for growth we encourage you to apply for thisposition. Immediateresponsibilities: Understand businessdomain key initiatives and quality criteria Lead...

  • GCP Data Engineer

    2 weeks ago

    sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience:6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...