Data Engineer
Responsibilities:
- Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers
- Help develop solutions for streaming, real-time, and search-driven analytics
- Must have a firm understanding of delivering large-scale data sets solutions and SDLC best practices
- Transform complex analytical models in scalable, production-ready solutions
- Utilizing programming languages like Java, Scala, Python
- Manage the development pipeline of distributed computing Big Data applications using Open Source frameworks like Apache Spark, Scala and Kafka on AWS and Cloud based data warehousing services such as Snowflake.
Basic qualifications:
- Bachelor's degree
- Experience with the Software Development Life Cycle (SDLC)
- Experience working on a big data platform
- Experience working with Spark, Pyspark, Python
- Experience in Scala/Java
- Experience in Python/Aws