Modis is seeking a Data Engineer for a contract role in New York City. Modis is seeking a Data Engineer to support our client where you would participate in an analytics project that uses data to know about the quality and effectiveness of their programs. In the role of Data Engineer, responsibilities include Integrating data from various sources (data warehouses, data marts) utilizing on-premises or cloud-based data structure Developing and implementing streaming, data lake and analytics big data solutions Creating integration of data using knowledge of ETL techniques and frameworks using Databricks Creating data pipelines to AWS cloud environment Required experience for the Data Engineer include Experience using ETL processes to extract and load data to build data repositories using Databricks, integrating data into Data Lake using Spark, PySpark, Hive, Kafka Streaming, etc. Application development experience in cloud environment using AWS (AWS Services, S3, API gateway, Redshift, Lambda, etc.) Experience integrating PySpark with various sources including Snowflake, Oracle, etc. Ability to make changes to existing Databricks framework, add new sources and tables Our client is motivated! To be considered, please apply today. We are actively monitoring applications. Thank you for partnering with Modis!
Associated topics: data administrator, data analyst, data center, data engineer, data integration, data management, data warehouse, data warehousing, etl, sql