i running datastax enterprise cluster (with gossipingpropertyfilesnitch). have 2 datacenters, analytics , cassandra. analytics nodes forms spark cluster. considering merging 2 clusters better utilize resources.
when enable spark (in /etc/dse/default) on cassandra nodes new master , seems nodes aren't joining same spark cluster analytics nodes. can somehow make cassandra datacenter nodes join analytics spark cluster?
because you're using gossipingpropertyfilesnitch, must change dc new spark nodes in. otherwise continue in so-named "cassandra" datacenter.
edit: short answer headline questions "no". separate dc's assigned separate spark masters , don't share resources on spark jobs.
Comments
Post a Comment