Showing posts with label by Alexey. Show all posts
Showing posts with label by Alexey. Show all posts

26 December 2015

Codeforces Submissions: Dataset for Source Code Analysis

Codeforces Submissions Dataset

I wanted to do some analysis on source code, and I needed a dataset where code snippets are labeled with the programming language they are in. I scraped this data from codeforces.com, which is a website for holding programming contests. In this post, I share this data.

tl;dr Scroll down to get the links.

17 December 2015

Test-Driven Machine Learning

Test-Driven Machine Learning

The book “Test-Driven Machine Learning” by Justin Bozonier, published by Packt Publishing, is in print now. I was a technical reviewer of this book, and in this post you will learn some details about it. The book is available on the publisher’s website as well as on Safari Books Library.

19 October 2015

Data Science Interview Questions

Data Science Interview Questions


Source: Data Science: An Introduction

Our IT4BI Master studies finished, and the next logical step after graduation is finding a job. I was interested in Data Science jobs and this post is a summary of my interview experience and preparation.

The term “Data Science” is not yet well establish, so interviews for Data Science jobs might include a very broad range of questions, depending on the interpretation of the term by a particular company. In this post I attempt to organize Data Science interview questions in some usable form, but it might also be biased by how I see Data Science myself. I hope you also can find it useful.

18 October 2015

Java Interview Questions

Java Interview Questions

In the past, I was a Software Developer, and my primary programming language was Java. I also quite often interviewed people and also sometimes was an interviewee. In this post, I would like to share typical questions that you might expect at a job interview for a Java Developer position.

15 October 2015

Mastering Data Analysis with R



The book "Mastering Data Analysis with R" by Gergely Daróczi, published by Packt Publishing, is in print now, and I had a pleasure to be a technical reviewer of this book.

If you're a Data Scientist who's looking to master R, this book is a good choice. It's already available on the publisher's website and on Safari books online.

6 June 2015

The Four Fundamental Subspaces

The Four Fundamental Subspaces

This is a first blog post in the series “Fundamental Theorem of Linear Algebra”, where we are working through Gilbert Strang’s paper “The fundamental theorem of linear algebra” published by American Mathematical Monthly in 1993.

In this post, we will go through the first two parts of the Fundamental Theorem: the dimensionality and the orthogonality of the Fundamental Subspaces.


Original Strang’s Diagram from the paper.

The Fundamental Theorem of Linear Algebra by G. Strang

The Fundamental Theorem of Linear Algebra

This is a series of articles devoted to Gilbert Strang’s Paper “The fundamental theorem of linear algebra” published by American Mathematical Monthly in 1993.

23 April 2015

Apache Mahout Samsara: The Quick Start

Apache Mahout Samsara: The Quick Start

Last week the newest Apache Mahout 0.10 was released. One of the new features it has is a new math environment called “Samsara”, or Mahout Scala/Spark Bindings.

Samsara is a Linear Algebra library for Mahout. It’s written in Scala, which makes it possible to use operator overloading and it features nice R-like or Matlab-like syntax for basic Linear Algebra operations. For example, matrix multiplication is just X %*% Y. What is more, these operations can be distributed and run by an executing environment - currently by Apache Spark.

In this article we will see how to quickly set up a basic skeleton project and then we’ll try to do some very simple analysis on a 200 MB dataset.

9 March 2015

Naive Bayes on Apache Flink

In this blog post we are going to implement a Naive Bayes classifier in Apache Flink. We are going to use it for text classification by applying it to the 20 Newsgroup dataset. To understand what is going on, you should be familiar with Java and know what MapReduce is. If you have seen and understood a word count example in any system, you're good to go. If you haven't heard of MapReduce or haven't seen the word count, you may first have a look at our introductory post "Hadoop and MapReduce".

4 March 2015

Hadoop and MapReduce


In this article we will briefly discuss the computation paradigm MapReduce, and Apache Hadoop as one of its implementations. We won't get into much details, and we even won't implement the Word Count on Hadoop, but it should give some foundation for the future articles about tools for scalable data processing.

15 February 2015

Spring Batch Essentials



The book "Spring Batch Essentials" by Packt Publishing is in print now, and I had a pleasure to be a technical reviewer of this book.

Spring Batch is a tool for creating ETL ("Read/Process/Write") jobs: for batch processing large portions of enterprise data that requires sophisticated transformations and involves complex business logic. It gives you a possibility to manage jobs easily, supports transactions and allows job execution to be scaled to process large volumes of data.

4 February 2015

Best Time to Learn Linear Algebra is Now!



Linear Algebra is a crucial prerequisite for many things, including Statistics, Data Mining, Machine Learning, Computer Vision, Image Processing and many many others, so it's very important to know the basics of Linear Algebra to understand more advanced concepts. For example, it's really helpful for our IT4BI studies, especially for the specialization at TU Berlin.

And the best time to learn Linear Algebra or refresh your knowledge about it is right now! At this moment there are a couple of nice MOOCs that have just started and a few more are about to start in the nearest future.

Even if you don't join right now, they should be available in the future for learning as self-paced versions. Additionally I would like to include my favorite video courses on Linear Algebra, they are also for learning at your own speed with no deadlines.

28 January 2015

IT4BI FAQ

I quite often receive questions about the IT4BI program: my CV is on the program's website, and people see my email there and write me. Also, I get quite a lot of questions from social networks. I usually try my best to give answers to all of them, but many questions repeat again and again, so it's a good idea to create a FAQ and make the answers are available to everybody, so I don't have to repeat myself. A fairly large part of the questions are about the admission process, and I already addressed some of them in IT4BI: How To.

24 January 2015

IT4BI: How To

In the post European Master Programs in Data Analysis I listed some Master programs that I myself applied to. There I also briefly outlined how to apply to them. In this post, I would like to give more details about the process of applying to the program of my choice: Erasmus Mundus IT4BI. This is mostly based on my experience and I would like to share this with you.

Additionally, I sometimes get questions by email about the program and quite a lot of them are about the process: documents, motivation letters, etc. In this post I will also address these questions, and spare myself the troubles of typing the same text over and over again :)

15 January 2015

European Master Programs in Data Analysis

Some time ago, in 2012, I decided that I wanted to continue my education and get a Master's Degree. I wanted to get more involved into data analysis and related things like machine learning or data mining. Secondly, this had to be a program in Europe because I didn't want to travel too far - back then I lived in Poland. And lastly, I wanted to find a program with both tuition waivers and monthly allowances to cover living expenses.

I started actively looking for programs that met these criteria and now I would like to share my experience. In this blog post I list the most interesting programs (to me) and I include only ones that I myself applied to. I will not describe the programs/scholarships in details, but instead will refer to links with information. However I will add some things that I think are important: e.g. the process of applying, interesting details, etc.

7 January 2015

IT4BI: Distributed and Large-Scale Business Intelligence


The first semester of the second year is devoted to specialization, and there are 3 possible choices in the IT4BI program. One of them is "Distributed and Large-Scale Business Intelligence" and it is delivered by the DIMA group at the Technical University of Berlin. It is the specialization of my choice, so I'm happy to share my experience about it in this post.

26 December 2014

IT4BI First Year: Business Intelligence Fundamentals


The first year of the IT4BI program is devoted to Business Intelligence fundamentals. There is plenty of information on the website of the program, including the course content page and the course description document. Even though these resources are comprehensive enough, I would still like to add a few details about the curriculum, so you can compare what is written on the website with the things we studied.