Project 3

Project 3

Stars meme


Data lives in /bigdata/data/pan-starrs1 or /ssd/data/pan-starrs1 on delenn (not in HDFS). Find the 100 largest stars according to pixel area and report their location in RA/Dec coordinates. The RA/Dec coordinates are calculated as:

ra  = ra_for_this_image  + (0.25/3600) * ((img_width-x)-img_width/2)
dec = dec_for_this_image + (0.25/3600) * ((img_height-y)-img_height/2)

where ra_for_this_image and dec_for_this_image are found in the file /bigdata/data/pan-starrs1/radec.csv. If RA<0, add 360. RA/Dec coordinates can be entered on this website in the form ra,dec e.g. 206.126,7.15499.

Use Spark. Likely use OpenCV. Consider using the GPU. Do not use R. Your final output (top-100) must be produced by Spark.

If you use C++ code, run g++ on delenn as follows:

g++ -Wall -g `pkg-config opencv --cflags --libs` -o count count.cpp

CINF 401 material by Joshua Eckroth is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License. Source code for this website available at GitHub.