title: basedir must be absolute: ?/.ivy2/local
body: <p>I'm writing here in a full desperation state... </p>
  
  <p>I have 2 users:</p>
  
  <ul>
  <li>1 local user, created in Linux. Works 100% fine, word count works perfectly. Kerberized Cluster. Valid ticket.</li>
  <li>1 Active Directory user, can login, but pyspark instruction (same word count) fails. Same kdc ticket as the one above.</li>
  </ul>
  
  <blockquote>
    <p>Exception in thread "main" java.lang.IllegalArgumentException: basedir
    must be absolute: ?/.ivy2/local
        at org.apache.ivy.util.Checks.checkAbsolute(Checks.java:48)
        at org.apache.ivy.plugins.repository.file.FileRepository.setBaseDir(FileRepository.java:135)
        at org.apache.ivy.plugins.repository.file.FileRepository.(FileRepository.java:44)
        at org.apache.spark.deploy.SparkSubmitUtils$.createRepoResolvers(SparkSubmit.scala:943)
        at org.apache.spark.deploy.SparkSubmitUtils$.buildIvySettings(SparkSubmit.scala:1035)
        at org.apache.spark.deploy.SparkSubmit$$anonfun$2.apply(SparkSubmit.scala:295)
        at org.apache.spark.deploy.SparkSubmit$$anonfun$2.apply(SparkSubmit.scala:295)
        at scala.Option.getOrElse(Option.scala:121)
        at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:294)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:153)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)</p>
  </blockquote>
  
  <p>The Code I'm running. Super simple.</p>
  
  <pre><code>import findspark
  findspark.init()
  from pyspark import SparkConf, SparkContext
  conf = SparkConf().setMaster("yarn")
  sc = SparkContext(conf=conf)
  </code></pre>
  
  <p>It ends in error in the last instruction with the above error (see exception). </p>
  
  <p><code>?/.ivy2/local</code> -> This is the problem but I have no idea what's going on :(.</p>
  
  <p>With the Linux user it works perfectly... but with the AD user that doesn't exists in the local system, but has /home/userFolder ... I have this problem :(</p>
  
  <p>Please help... I've reach the point of insanity... I've googled every corner of the internet but I haven't found any solution to this problem/mistake :( stackoverflow is my last resort heeeeeeeeeelp</p>