Data Engineer
2 weeks ago
As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is collected, processed, stored, and analyzed efficiently and accurately.About SatSureSatSure is a deep tech, decision Intelligence company that works primarily at the nexus of agriculture, infrastructure, and climate action creating an impact for the other millions, focusing on the developing world. We want to make insights from earth observation data accessible to all.If you are interested in working in an environment that focuses on the impact on society, driven by cutting-edge technology, and where you will be free to work on innovative ideas and be creative with no hierarchies, SatSure is the place for you.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines to acquire, ingest, clean, transform, and process geospatial data from various sources such as satellites, aerial, drones, and geolocation services.Data Ingestion, Storage and Extraction: Develop data models and schemas tailored to geospatial data structures, ensuring optimal performance and scalability for storage and retrieval operations.Spatial Database Management: Manage geospatial databases, including both traditional relational databases (e.g., PostgreSQL with PostGIS extension) and NoSQL databases (e.g., MongoDB, Cassandra) to store and query spatial data efficiently.Geospatial Analysis Tools Integration: Integrate geospatial analysis tools and libraries (e.g., GDAL, GeoPandas, Fiona) into data processing pipelines and analytics workflows to perform spatial data analysis, visualization, and geoprocessing tasks.Geospatial Data Visualization: Collaborate with data visualization specialists to create interactive maps, dashboards, and visualizations that effectively communicate geospatial insights and patterns to stakeholders. (frontend related)Performance Optimization: Identify and address performance bottlenecks in data processing and storage systems, leveraging techniques such as indexing, partitioning, and parallelization to optimize geospatial data workflows.Data Quality Assurance: Implement data quality checks and validation procedures to ensure the accuracy, completeness, and consistency of geospatial data throughout the data lifecycle.Geospatial Data Governance: Establish data governance policies and standards specific to geospatial data, including metadata management, data privacy, and compliance with geospatial regulations and standards (e.g., INSPIRE, OGC).Collaboration and Communication: Collaborate with cross-functional teams to understand geospatial data requirements and provide technical expertise and support. Communicate findings, insights, and technical solutions effectively to both technical and non-technical stakeholders.Requirements:Must-have:Bachelor's or Master's degree in Computer Science or a related field.3-9 years of experience working in the field and deploying the pipelines in production.Strong programming skills in languages such as Python, Java, or Scala, with experience in geospatial libraries and frameworks (e.g., Rasterio, Shapely).Experience with distributed computing frameworks (e.g., Apache Spark, Airflow) and cloud-based data platforms (e.g., AWS, Azure, Google Cloud Platform).Familiarity with geospatial data formats and standards (e.g., GeoJSON, Shapefile, KML) and geospatial data visualization tools (e.g., Mapbox, Leaflet, Tableau).Strong analytical and problem-solving skills, with the ability to work with large and complex geospatial datasets.Good-to-have:Proficiency in SQL and experience with geospatial extensions for relational databases (e.g., PostGIS).Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.Nice to have experience with geospatial libraries such as Rasterio, Xarray, Geopandas, and GDAL.Nice to have Knowledge of distributed computing frameworks such as Dask.STAC, GeoParquet, Cloud native tools.Productionising Data Science code.The role of a Data Engineer for Geospatial Data is crucial in enabling organizations to leverage the power of geospatial information for various applications, including urban planning, environmental monitoring, transportation, agriculture, and emergency response.Benefits:Medical Health Cover for you and your family, including unlimited online doctor consultationsAccess to mental health experts for you and your familyDedicated allowances for learning and skill developmentComprehensive leave policy with casual leaves, paid leaves, marriage leaves, bereavement leavesTwice a year appraisalInterview Process:Intro callAssessmentPresentationInterview rounds (ideally up to 3-4 rounds)Culture Round / HR round
-
Data Engineer
2 weeks ago
Bangalore Urban, India ACL Digital Full timeHi all, We are hiring for Data Engineer with one of our renowned client with pan India location.Looking for candidates with 5 to 7 years of experienceRelevant 5+ years into Data Engineering GCP Cloud Data bricks,Unity catalog, Python/Pyspark Terra form scripts
-
Data Engineer
2 weeks ago
Bangalore Urban, India ACL Digital Full timeHi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant 5+ years into Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts
-
Data Engineer
4 days ago
Bangalore Urban, India Tata Consultancy Services Full timeGreetings from TCS! Job Title: Azure Data Engineer Required Skillset: AWS(preferable)/AZURE Databricks Location: PAN INDIA Experience Range: 5-14 years Job Description: Must Have: Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks. Proficiency in Databricks platform,...
-
Data Engineer
2 weeks ago
Bangalore Urban, India Synechron Full timeGood-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: Bangalore Experience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...
-
Data Engineer
3 weeks ago
Bangalore Urban, India Synechron Full timeGood-day, We have immediate opportunity for Data Engineer (Python, Spark/Scala) . Job Role: Data Engineer (Python, Spark/Scala) Job Location: Bangalore Experience- 5 to 10 years Notice Period: Immediate joiner only. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines...
-
Data Engineer
6 days ago
Bangalore Urban, India Tata Consultancy Services Full timeGreetings from TCS!Job Title: Azure Data EngineerRequired Skillset: AWS(preferable)/AZURE DatabricksLocation: PAN INDIAExperience Range: 5-14 yearsJob Description:Must Have:Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks.Proficiency in Databricks platform, management,...
-
Data Engineer
4 weeks ago
Bangalore Urban, India V2Soft Full timeData Engineer :8+year experience in design and development of streaming data pipelines.Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK/Flink/Spark/Scala. Very good knowledge on atleast 3 out of the 4 technologiesDesirable experience in Databricks, Snowflake or any data warehouse...
-
Data Engineer
4 weeks ago
Bangalore Urban, India V2Soft Full timeData Engineer : 8+year experience in design and development of streaming data pipelines. Experience to deal with large stream volumes. Implementation experience ( atleast couple of projects ) in MSK/Flink/Spark/Scala. Very good knowledge on atleast 3 out of the 4 technologies Desirable experience in Databricks, Snowflake or any data warehouse technologies....
-
Data Engineer
4 weeks ago
Bangalore Urban, India Tata Consultancy Services Full timeOpening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilitiesDevelop Spark and SCALA code as per requirement.Build efficient and optimized ETLs for data ingestion/transformations.Should be able to customize and update the Quantexa UI as per business requirement.Documentation of the...
-
Senior Data Engineer
3 weeks ago
Bangalore Urban, India Tata Consultancy Services Full timeGreetings from TCS!!! TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before the interview. To create an...