Skip the PhD learn spark for data scientist survey
Once IBM got behind it, this framework has taken off
if you spend half of your time (4+ hours) doing basic exploratory analysis, you can expect your salary to drop by $6,609.
Here’s one big surprise: The language R didn’t fare particularly well, which was definitely not expected. The percentage of survey respondents who report using R fell from 57 in the 2014 survey to 52 this year. Spark, by comparison, grew 17 percent, while Scala grew 10 percent. (For what it’s worth, Hadoop’s use dropped from 19 percent to 13 percent, while Java dropped from 32 percent to 23 percent). …
While R remains one of the four primary tools used in data science (along with SQL, Excel, and Python), the usage pattern around R is changing, O’Reilly says.
“R is a prime example of a tool that is bridging the divide between open source and proprietary tools,” the report says. We’re seeing more interest in R paid by big software companies, including Microsoft, which bought Revolution Analytics, and Teradata, which just added support for R in its eponymous data warehousing environment.
This is reflective of changing times for R. “[T]he open-source-only crowd might be finding they don’t need such a large selection of tools, that Spark and Python do the job just fine,” O’Reilly says. “The large number of R packages has often been cited as a key advantage of R over tools such as Python, but this is not the kind of advantage that is guaranteed to last: there is no reason why developers of other open source tools can’t gradually build on their own libraries to catch up.”
You can download your copy of the O’Reilly 2015 Data Science Salary Survey here.
FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!