Tag: hortonworks-data-platform

AWK usage issue while archiving HDFS files in Hortonworks Distribution

awk bash hadoop hortonworks-data-platform linux

I am trying to move files in a HDFS directory that are over 3 days old to an archiving folder in HDFS. AWK Script: Note: cmd variable would have a mv command once this script starts working Issue: Value of variable X is constant Value of Variable Y is constant Unable to get day difference between 2 date , i

How to let Apache Spark on Windows access Hadoop on Linux?

apache-spark hadoop hortonworks-data-platform linux windows

First, I have almost no experience on Apache Hadoop and Apache Spark. What I want for now is as follows: Hadoop is running on Hortonworks Sandbox 2.1, which is installed on a Windows 7 machine. Spark shell and Spark programs are running on the Windows 7 machine, which is the same machine as above. Spark shell and Spark programs can