Cloud Data Engineer Jobs

Need a Cloud data engineer with strong expertise in SQL, ETL and AWS Python PySPARK
Required Skills ,Python,AWS Services
Nice to have skills ,PySpark 6.Technology -Not Applicable
Tech Stack : Pyspark, AWS, SQL, Airflow, Kafka Streams etc
• Principle Engineer should have strong conceptual experience of data sourcing and management but should still be hands on
• Work location is remote (anywhere in Canada) but must work on PST time zone
• Target start date is 4/6
Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
Ability to design and implement end to end solutions.
Experience publishing RESTful API’s to enable real-time data consumption using OpenAPI specifications
Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
Familiar with Distributed Stream Processing frameworks for Fast & Big Data like ApacheSpark, Flink, Kafka stream
Build utilities, user defined functions, and frameworks to better enable data flow patterns.
Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to.
Roles & Responsibilities
Associate need to perform data analysis, collaborating with database developers and enhance data collection and storage procedures, and prepare data analysis reports.
• Highly capable data quality analyst to develop procedures to enhance the accuracy and integrity of organizations data.
• The data quality engineer should exhibit extensive knowledge of data engineering, analysis techniques and experience
• The data quality engineer should have knowledge in Data Architecture
• The data quality engineer should have good knowledge in API Testing with good knowledge on AWS
• Additional desired skills which are good to have is knowledge on Python