Advertisement

Data Engineering and Developer Tools for Big Data

Data Engineering and Developer Tools for Big Data At JetBrains, we strive to build the most intelligent and ergonomic tools for developers. Whatever the language or technology stack, we aim to make the developer experience as amazing as possible.

Recently, we introduced Big Data Tools – a new IntelliJ IDEA plugin which integrates Spark and provides support for editing and running Zeppelin notebooks. This is why we've invited Jeff Zhang, an experienced data engineer, famous speaker, and contributor to big data related projects including Apache Zeppelin, to host a webinar.

Together, we explore what data engineering is about, what purpose it has, what the buzzword “Big Data” really stands for, and importantly, some examples of developer tools that are most instrumental and productive in doing data engineering. We dive into how data engineering contributes to Machine Learning and Exploratory Data Analysis, and what place #Spark, #Hadoop, #Zeppelin, and some other open-source tools occupy in the data engineering industry.

Resources:
Big Data Tools Plugin:
Meet Big Data Tools:
JetBrains Big Data Tools on Twitter:

#BigData #IntelliJIDEA #MachineLearning #Plugin

About the Presenter:
Jeff Zhang has 11 years of experience in big data industry. He is an open source veteran, start to use hadoop since 2009 and is PMC of several Apache projects Tez/Livy/Zeppelin and committer of Apache Pig. His past experience is not only on big data infrastructure, but also on how to leverage these big data tools to get insight. He speaks several times on big data conferences like hadoop summit, strata + hadoop world. Now he works in Alibaba Group as a staff engineer. Prior that he works in Hortonworks where he developed these popular big data tools.

JetBrains,software development,developer tools,programming,developer,big data,big data tools,hadoop,zeppelin,spark,intellij idea,apache zeppelin,big data tools plugin,plugin,jetbrains marketplace,machine learning,exploratory data analysis,open source,webinar,

Post a Comment

0 Comments